JP6737309B2 - Video system and video program - Google Patents

Description

The present invention relates to a video system and a video program.

2. Description of the Related Art Conventionally, there is known an image system in which a screen is formed of a substance such as a fluid and an image is displayed on the screen (for example, refer to Patent Document 1 and Patent Document 2).

Japanese Patent Publication No. 7-60298 Japanese Utility Model Publication No. 2-44731

However, in the techniques of Patent Documents 1 and 2, a viewer who views an image throws or moves a real object such as a ball toward the screen, and when the real object passes through the screen, the viewer is shielded by the screen. There is a problem that it is difficult to visually recognize the real object, and the real object is not displayed in the image, and there is no continuity between the real object and the image, resulting in lack of reality.

The present invention has been made in view of such problems, and an object thereof is to provide a video system that improves the reality of a video displayed on a screen.

In order to solve the above-mentioned problems, an image system according to a first aspect of the present invention provides a forming means for forming a screen by dispersing a substance in a space, and a position of the real object when the real object passes through the screen. Generating means for detecting information and determining the position of the virtual object in the virtual space based on the position information detected by the detecting means, and generating an image including the virtual object arranged at the determined position And means for controlling the display of the image generated by the generation means on the screen when the real object passes through the screen.

According to the first aspect, it is possible to provide continuity between the position of the real object and the position of the virtual object. Therefore, according to the first aspect, it is possible to improve the reality of the image displayed on the screen.

According to the present invention, it is possible to improve the reality of the image displayed on the screen.

It is a figure which shows an example of the whole structure of the video system which concerns on 1st embodiment of this invention. It is a figure which shows schematically an example of the hardware constitutions of the terminal device shown in FIG. It is a block diagram which shows roughly an example of the functional means of the video system which concerns on 1st embodiment of this invention. It is a flowchart which shows the flow of a process of the video system which concerns on 1st embodiment of this invention. (A) is a diagram showing a state of an image when a player hits a first real object (tennis ball) and the first real object is facing the screen. (B) is a diagram showing a state of an image and the like when the first real object passes through the screen, following (A). (C) is a diagram showing a state of an image and the like when the first real object is moving away from the screen, following (B). FIG. 13A is a diagram showing a state of an image and the like when the second real object ejected in response to the opponent character hitting the first virtual object is heading to the screen, following FIG. (B) is a diagram showing a state of an image and the like immediately after the second real object passes through the screen, following (A). (C) is a diagram showing a state of an image and the like when the second real object passes through the screen, following (B). It is a conceptual diagram which shows the position of the battle character in a virtual space or a 2nd virtual object, and the positional relationship of an actual ejection means. It is a figure which shows an example of the whole structure of the video system which concerns on 2nd embodiment of this invention. (A) is a diagram showing a state of the first virtual object when the player P swings down the katana as the first real object, and a part of the katana passes through the screen. FIG. 6B is a diagram illustrating a state of the first virtual object when half or more of the first real object has passed through the screen, following FIG. FIG. 13C is a diagram showing a state where the artificial hand projects from the screen toward the player, following FIG. (A) is a diagram showing a state of an image when a player is playing a golf game. (B) is a diagram showing a state of an image when a player is playing a baseball game. It is a figure which shows an example of the whole structure of the video system which concerns on a modification.

Hereinafter, a plurality of embodiments of the present invention will be described with reference to the accompanying drawings. In order to facilitate understanding of the description, the same components and steps in the drawings will be denoted by the same reference symbols as much as possible, and redundant description will be omitted.

--- First embodiment ---
First, a video system according to the first embodiment of the present invention will be described. This image system relates to a system in which a substance is dispersed in a space to form a screen and an image is displayed on the screen. The substance is not particularly limited as long as an actual object can pass through the screen, and examples thereof include fluids such as liquid and gas, paper pieces, wood pieces, powder such as sand, and light-emitting elements including LEDs and the like. Are listed. The method of spraying is also not particularly limited, but it can be sprayed by dropping or ejecting a substance, spraying by blowing air on the substance, or by applying external force such as magnetic force or static electricity to the substance. Good. Hereinafter, in the first embodiment, a case will be described in which the image system disperses the fluid by ejecting the fluid. Further, in the first embodiment, the case where the video displayed by the video system is the video related to the game is explained, but other video, for example, the video related to the haunted house or the attraction may be used.

<Overall structure>
FIG. 1 is a diagram showing an example of the overall configuration of a video system 1 according to the first embodiment of the present invention.

As shown in FIG. 1, the image system 1 according to the first embodiment includes a substance spraying device 10, a detecting device 12, a projecting device 14, an ejecting device 16, a moving mechanism 18, a collecting net 20, and collecting. The hole 22, the resistance member 24, and the terminal device 30 are provided.

The substance spraying device 10 includes a nozzle, and sprays a substance M (for example, a fluid such as water) supplied from a supply source (not shown) to a space below the nozzle to spray the substance M into the space and screen 10A. Is a device for forming.

The detection device 12 is a device that detects position information and the like of the first real object O1. Examples of the detection device 12 include a position sensor and a camera. In the first embodiment, a case where the detection device 12 is a camera will be described. The first real object O1 is an object moved by the user of the video system 1 (the player P in the first embodiment). Examples of such a first real object O1 include a ball, a bullet, a sword, and a cane. In the first embodiment, a case where the first real object O1 is a tennis ball that is moved (flyed) by the player P hitting with a racket will be described as an example.
In addition, the detection device 12 includes a first detection device 12A and a second detection device 12B. The first detection device 12A is a device that detects position information and the like of the first real object O1 when the first real object O1 passes through the screen 10A. The second detection device 12B detects position information and the like of the first real object O1 located in front of the screen 10A. The "front" means the player P side with respect to the screen 10A.
Further, the detection device 12 detects the direction information of the first real object O1 when passing the screen 10A by the first detection device 12A and/or the second detection device 12B. The terminal device 30 may detect the direction information of the first real object O1 based on the information detected by the detection device 12. Further, the detection device 12 may detect shape information and speed information of the first real object O1. The "direction information" includes not only the moving direction information of the first real object O1 but also the direction information of the first real object O1 in combination with the shape information of the first real object O1. You can leave.

The projection device 14 is a device that projects the image 14A on the screen 10A configured by a projector or the like. This image 14A is an image obtained by projecting a virtual space in which the position of the player P is set as the viewpoint position as a two-dimensional image, and includes an opponent character C that is an opponent of the player P. The image 14A also includes a first virtual object O2 displayed after the first real object O1 has passed through the screen 10A. This first virtual object O2 may be related to the first real object O1 or may not be related to the first real object O1. However, from the viewpoint of maintaining continuity with the first real object O1, it is preferable that the first virtual object O2 imitates the first real object O1. The first virtual object O2 may be of the same type as the first real object O1 or may be of a different type. When the type of the first virtual object O2 is different from that of the first real object O1, for example, the first real object O1 may be a tennis ball and the first virtual object O2 may be a banana, melon, coconut, or the like. However, from the viewpoint of maintaining the type continuity with the first real object O1, it is preferable that the first virtual object O2 be of the same type as the first real object O1 (ball in this case). Similarly, the first virtual object O2 may have the same shape as the first real object O1 or may have a different shape. However, from the viewpoint of maintaining the continuity of the shape with the first real object O1, it is preferable that the first virtual object O2 has the same shape as the first real object O1. The first virtual object O2 may have the same color as the first real object O1 or may have a different color. However, from the viewpoint of maintaining color continuity with the first real object O1, the first virtual object O2 is preferably the same color as the first real object O1. Similarly, the first virtual object O2 may or may not be related to the game provided to the player P.

The ejection device 16 is a device that is provided in the depth direction of the screen 10A and ejects a second real object that is the same as or different from the first real object O1 toward the front direction of the screen 10A. Examples of the second real object include a ball. In the first embodiment, the second real object is a tennis ball like the first real object O1. Note that the depth direction means a passage destination of the first real object O1 that is on the opposite side of the player P with respect to the screen 10A and moves from the player P side toward the screen 10A. In other words, the depth direction means the side opposite to the side on which the video 14A is viewed.

The moving mechanism 18 is a mechanism that moves the ejection device 16 to eject the second real object from an arbitrary position on the screen 10A. The moving mechanism 18 is composed of, for example, a rail and a drive unit. Further, not only in the horizontal direction, but also in the vertical direction (not shown) may be moved.

The recovery net 20 is a net for receiving the first real object O1 flying in the depth direction of the screen 10A.

The recovery hole 22 is a hole for recovering the first real object O1 that has been received by the recovery net 20 and has fallen down. The recovery hole 22 is connected to the moving mechanism 18 via a replenishment path (not shown), and the first real object O1 collected in the recovery hole 22 is collected at one place through the moving mechanism 18 and ejected there. The device 16 may be moved and replenished.

The resistance member 24 is a member that protects the recovery net 20 by resisting the movement of the first actual object O1 in the depth direction. Examples of the resistance member 24 include elastic bodies such as rubber and cushion, fibers, and the like.

The terminal device 30 is connected to various devices such as the substance spraying device 10 described above, the detection device 12, the projection device 14, the ejection device 16, and the moving mechanism 18, and gives various device information for control and various devices. An information processing device that acquires information from the device.

<Hardware configuration>
FIG. 2 is a diagram schematically showing an example of the hardware configuration of the terminal device 30 shown in FIG.

As shown in FIG. 2, the terminal device 30 includes a control device 32, a communication device 34, and a storage device 36. The control device 32 mainly includes a CPU (Central Processing Unit) 32A and a memory 32B.

In the controller 32, the CPU 32A functions as various functional means by executing a predetermined program stored in the memory 32B, the storage device 36, or the like. Details of this functional means will be described later.

The communication device 34 is composed of a communication interface or the like for communicating with an external device. The communication device 34 is connected to various devices such as the substance spraying device 10, the detection device 12, the projection device 14, the ejection device 16 and the movement mechanism 18 described above, and for example, the detection device 12, the ejection device 16 and the movement mechanism. Various kinds of information are transmitted and received to and from 18.

The storage device 36 is composed of a hard disk or the like. The storage device 36 stores various programs and various information necessary for execution of processing in the control device 32, and information of processing results.

The terminal device 30 can be realized by using an information processing device such as a dedicated or general-purpose server computer. Further, the terminal device 30 may be configured by a single information processing device or may be configured by a plurality of information processing devices distributed on the communication network. Further, FIG. 2 only shows a part of the main hardware configuration of the terminal device 30, and the terminal device 30 can have other configurations that a server generally has. Further, the hardware configuration of the plurality of terminal devices 30 can also have the same configuration as that of the terminal device 30, except that, for example, the operation device, the display device, and the like are provided.

<Functional means>
FIG. 3 is a block diagram schematically showing an example of functional means of the video system 1 according to the first embodiment.

As shown in FIG. 3, the video system 1 includes a forming unit 40, a detecting unit 42, a projecting unit 44, an ejecting unit 46, a moving unit 48, a resistance unit 50, and a collecting unit outside the terminal device 30. Functional means such as the means 52 is provided. Further, the video system 1 includes functional means such as a storage means 60, a game means 62, a specifying means 64, a generating means 66, and a control means 68 inside the terminal device 30. In addition, a part of the detection unit 42 may be provided inside the terminal device 30.

The forming unit 40 is a functional unit that forms a screen 10A by dispersing one type of substance M in a space. Such forming means 40 is realized by, for example, the above-mentioned substance spraying device 10.

The detection unit 42 is a functional unit that detects position information and direction information of the first real object O1 when the first real object O1 passes through the screen 10A. Further, the detection unit 42 may detect at least one of the shape information, the speed information, the rotation speed information, and the rotation direction information of the first real object O1. Such detection means 42 is realized by, for example, the above-described detection device 12 or the detection device 12 and the CPU 32A.

The projection unit 44 is a functional unit that projects the image 14A on the screen 10A. Such projection means 44 is realized by, for example, the above-mentioned projection device 14.

The ejection means 46 is a functional means that is provided in the depth direction of the screen 10A and ejects a second real object that is the same as or different from the first real object O1 toward the front side of the screen 10A based on the progress of the game. For example, the ejection unit 46 ejects the second real object when the fighting character C has the right to serve or when the fighting character C hits back the first virtual object O2. Such an injection unit 46 is realized by, for example, the above-described injection device 16.

The moving means 48 is a functional means for moving the ejecting means 46. The moving means 48 may have a function of moving the ejection means 46, or may have a function of moving the resistance member 24 instead of moving the ejection means 46. Such moving means 48 is realized by, for example, the moving mechanism 18 described above.

The resistance means 50 is a member that resists the movement of the first real object O1 in the depth direction. Such resistance means 50 is realized by the resistance member 24 described above. If the recovery net 20 has sufficient strength, the resistance means 50 may not be provided.

The collecting means 52 is a functional means for collecting the first real object O1 that has passed through the screen 10A. Such a collection means 52 is realized by the collection net 20, the collection hole 22, and the like.

The storage unit 60 is a functional unit that stores the video data 60A, the control parameter 60B, and the like. Such a storage unit 60 is realized by one or a plurality of storage devices 36. The video data 60A is video data for displaying the video 14A on the screen 10A. The control parameter 60B is a control parameter for controlling the forming unit 40, the detecting unit 42, the projecting unit 44, the ejecting unit 46, the moving unit 48, and the like.

The game means 62 is a functional means for advancing the game and providing it to the player P. In the first embodiment, the game means 62 advances a tennis game. Such a game means 62 is realized by the control device 32 executing a program stored in the storage device 36 or the like, and mainly detects the action of the player P directly or indirectly by the detecting means 42, the specifying means 46, or the like. Is detected, and the ejecting means 46, the moving means 48, the projecting means 44, and the like are operated based on this to advance the game.

The specifying unit 64 is a functional unit that specifies the first real object O1 based on the shape information detected by the detecting unit 42. For example, the identifying unit 64 compares the shape information detected by the detecting unit 42 with the shape data stored in advance in the storage unit 60 and associated with each of the identification information items of the plurality of first real objects to obtain the shape information. The first real object O1 is specified by acquiring the identification information corresponding to the shape data that matches with. The specifying unit 64 is realized by the control device 32 executing a program stored in the storage device 36 or the like. If the game provided by the game means 62 is limited to one game, such as a tennis game, the first real object O1 can be inferred to be a tennis ball, so the specifying means 64 can be largely omitted. is there.

The generation unit 66 determines the position of the first virtual object O2 in the virtual space based on various information detected by the detection unit 42, and the first virtual object O2 and the battle character C arranged at the determined position. It is a functional means for generating a video image 14A including, for example, the video data 60A as appropriate. Specifically, the generation unit 66 determines and determines the position substantially the same as the position indicated by the position information detected by the detection unit 42 as the position of the first virtual object O2 in the virtual space forming the image 14A. The image 14A in which the first virtual object O2 is placed at the position is generated.
Further, the generation unit 66 determines the moving direction of the first virtual object O2 in the virtual space based on the direction information detected by the detection unit 42, and moves the first virtual object O2 along the determined moving direction. Let For example, the generation unit 66 determines a direction substantially the same as the direction indicated by the direction information detected by the detection unit 42 as the moving direction of the first virtual object O2, and moves the first virtual object O2 in the determined moving direction. 14A is generated.
Further, the generation unit 66 determines the moving speed of the first virtual object O2 based on the speed information detected by the detection unit 42, and displays the image 14A that moves the first virtual object O2 in the virtual space at the determined moving speed. It may be generated. For example, the generation unit 66 determines the speed substantially the same as the speed indicated by the speed information detected by the detection unit 42 as the speed of the first virtual object O2, and moves the first virtual object O2 in the virtual space at the determined speed. The image 14A to be displayed may be generated. Further, the generation unit 66 may move the first virtual object O2 while decelerating it with the passage of time.
Further, the generation means 66 determines the rotation speed or rotation direction of the first virtual object O2 based on the rotation speed information or rotation direction information of the first real object O1 detected by the detection means 42, and the determined rotation speed or rotation. The image 14A including the first virtual object O2 that rotates in the direction may be generated. For example, the generation unit 66 generates the image 14A including the first virtual object O2 that rotates in the virtual space at the rotation speed or the rotation direction substantially the same as the rotation speed or the rotation direction indicated by the rotation speed information or the rotation direction information. Good.
Further, the generation unit 66 may generate the image 14A of the first virtual object O2 related to the first real object O1 identified by the identification unit 64.

Further, the generation unit 66 determines the position of the second virtual object in the virtual space based on the control information (for example, the control parameter 60B) of the control unit 68 for the ejection unit 46, and the second virtual object is set at the determined position. The control means 68 controls the display of the image 14A including the second virtual object generated by the generation means 66 on the screen 10A until the second real object passes through the screen 10A. ..
Further, the generation means 66 determines the direction and speed of the second virtual object in the virtual space based on the control information (for example, the control parameter 60B) of the control means 68 for the ejection means 46, and determines the direction and speed in the determined direction and speed. Two virtual objects may be moved.
Further, since the type of the second real object can be grasped in advance by the game provider, a second virtual object relating to the second real object is created in advance, and the generation means 66 causes the image 14A including the second virtual object. May be generated.
Further, the generation means 66 generates the image 14A according to the progress of the game. For example, the generation unit 66 generates the image 14A that moves the fighting character C according to the progress of the game.
The generation unit 66 as described above is realized by the control device 32 executing a program stored in the storage device 36 or the like.

The control unit 68 controls the forming unit 40, the detecting unit 42, the projecting unit 44, the ejecting unit 46, the moving unit 48, and the like based on the control parameter 60B. For example, the control unit 68 controls the projection unit 44 at the timing when the first real object O1 passes through the screen 10A, and the image 14A including the first virtual object O2 generated by the generation unit 66 is displayed on the screen 10A. Display (project). In other words, the control unit 68 controls the display of the image 14A including the first virtual object O2 generated by the generation unit 66 on the screen 10A. Such control means 68 is realized by the control device 32 executing a program stored in the storage device 36 or the like. The control means 68 continues to determine the position, direction, and speed of the first real object O1 in the virtual space even after the first real object O1 has passed through the screen 10A. From then to the distance of a predetermined distance or more, the projection means 44 may be continuously controlled to display (project) the image 14A including the first virtual object O2 on the screen 10A.

Further, the control means 68 adjusts the control parameter 60B based on, for example, various information detected by the detection means 42, the ability of the fighting character C, the progress of the game, etc., so that the ejection means 46 ejects the second real object. Control position, injection speed or injection direction. Further, the control unit 68 may control the injection amount or the number of injections by adjusting the control parameter 60B.
Further, the control unit 68 may control the amount of the substance M sprayed in the forming unit 40 based on the position of the first actual object O1. For example, in the tennis game, when the first real object O1 is located in front of the screen 10A in the tennis game, the control means 68 controls the amount of the substance M to be large in order to visually recognize the fighting character C, while the first real object O1 is controlled. When is located in the depth direction with respect to the screen 10A, the amount of the substance M may be controlled to a small amount in order to visually recognize the first actual object O1. On the contrary, the control means 68 controls the amount of the substance M to be small while concentrating the player P on the first real object O1 when the first real object O1 is located in the front direction of the screen 10A, while the first real object O1 is controlled. When the body O1 is located in the depth direction with respect to the screen 10A, the amount of the substance M may be controlled to be large in order to concentrate the player P on the image 14A.
Further, the control unit 68 may control the amount of the substance M sprayed in the forming unit 40 based on the progress of the game. For example, the control means 68 controls the amount of the substance M to be small in order to give the player P a feeling of entering the virtual world from the real world at the beginning of the game, and makes the virtual world immersive in the middle of the game. The amount of the substance M may be controlled to be large in order to give it to the player P, and the amount of the substance M may be controlled to be small at the end of the game in order to give the player P a sense of returning from the virtual world to the real world.
The control means 68 as described above is realized by the control device 32 executing a program stored in the storage device 36 or the like. In addition, instead of controlling the amount of the substance M to be sprayed, by configuring the recovery net 20 with a screen surface such as a cloth having a secured strength, the material M is sprayed in a game scene where the first real object O1 does not move. Alternatively, the image 14A may be projected on the collection net 20 behind it. At that time, it is desirable that the resistance means 50 and the ejection device 16 be moved outside the projection range of the image 14A.

<Process flow>
FIG. 4 is a flowchart showing a processing flow of the video system 1 according to the first embodiment. In this processing, the game means 62 starts the tennis game, the control means 68 controls the forming means 40 to spray the substance M in the space to form the screen 10A, and the control means 68 controls the projection means 44. It is started by displaying the image 14A including the battle character C on the screen 10A.

Further, FIG. 5A is a diagram showing a state of the image 14A when the player P hits the first real object O1 (tennis ball) and the first real object O1 is flying toward the screen 10A. is there.

(Step SP10)
The game means 62 determines whether or not the detection means 42 has detected the first real object O1 (tennis ball) blown by the player P in front of the screen 10A. Then, if the determination is affirmative, the process proceeds to step SP12, and if the determination is negative, the process returns to step SP10.

(Step SP12)
The detection means 42 detects the position information of the first real object O1 located in front of the screen 10A. And a process transfers to the process of step SP14.

(Step SP14)
The game means 62 determines whether or not the detection means 42 detects that the first real object O1 skipped by the player P passes through the screen 10A. Then, if the determination is affirmative, the process proceeds to the process of step SP16, and if the determination is negative, the process returns to the process of step SP14.

(Step SP16)
The detection means 42 detects the position information of the first real object O1 when passing through the screen 10A. Then, the process proceeds to the process of step SP18.

(Step SP18)
The detection means 42 detects the direction information of the first real object O1 when passing through the screen 10A. In the first embodiment, the detection means 42 detects the position information of at least two positions, that is, the position information of the first real object O1 located in front of the screen 10A and the position information of the first real object O1 when passing through the screen 10A. Is acquired in advance, and direction information is detected based on this. And a process transfers to the process of step SP20.

(Step SP20)
The detection means 42 detects the speed information of the first real object O1 when passing through the screen 10A. In the first embodiment, the detection unit 42 acquires the movement time to the position of the first real object O1 located in front of the screen 10A and the position of the first real object O1 when passing through the screen 10A, Based on this, speed information is detected. Then, the process proceeds to the process of step SP22.

(Step SP22)
The generation unit 66 determines the position of the first virtual object O2 in the virtual space based on the position information detected by the detection unit 42, and displays the image 14A including the first virtual object O2 arranged at the determined position. To generate. Then, the control unit 68 controls the display of the generated image 14A on the screen 10A when the first real object O1 passes through the screen 10A.

FIG. 5B is a diagram showing a state of the image 14A and the like when the first real object O1 passes through the screen 10A, following FIG. 5A.

As shown in FIG. 5(B), the first real object O1 passes through the screen 10A and is blocked by the screen 10A and cannot be seen by the player P. Instead, the first real object O1 is the same as the first real object O1. The virtual object O2 is displayed in the image 14A. It should be noted that an effect 14B such as flame or ice may be displayed around the first virtual object O2 depending on the player P, specifically, the attribute or type of the player P. Further, the effect 14B may be displayed according to the moving direction and the moving speed.

Returning to FIG. 4, the process proceeds to the process of step SP24.

(Step SP24)
The generation unit 66 determines the speed and movement direction of the first virtual object O2 (tennis ball) based on the speed information and the direction information of the first real object O1 detected by the detection unit 42. And a process transfers to the process of step SP26.

(Step SP26)
The generation unit 66 moves the first virtual object O2 in the image 14A along the determined speed and moving direction of the virtual object O. Along with this, the first virtual object O2 displayed on the screen 10A moves.

FIG. 5C is a diagram showing a state of the image 14A and the like when the first real object O1 is moving away from the screen 10A, following FIG. 5B.

As shown in FIG. 5C, a state in which the first virtual object O2 is moving toward the fighting character C is displayed in the image 14A.

Returning to FIG. 4, the process proceeds to the process of step SP28.

(Step SP28)
The control unit 68 controls the moving unit 48 to move the resistance unit 50 according to the progress of the game, the position of the first virtual object O2, the ability parameter of the character C, and the like. Here, in the tennis game, the resistance means 50 substitutes for a net or an obstacle, and when the first real object O1 hits the resistance means 50, the resistance means 50 bounces or falls down. If the size of the resistance means 50 is large (the same size as the screen 10A or the collection net 20), the resistance means 50 may not be moved. Then, the process proceeds to the process of step SP30.

(Step SP30)
The collecting means 52 collects the first real object O1 that has passed through the screen 10A. Further, the game means 62 calculates the landing point of the first virtual object O2 based on the speed and moving direction of the first virtual object O2 (tennis ball), the position of the resistance means 50, and the like. Then, the process proceeds to the process of step SP32.

(Step SP32)
The game means 62 determines, based on the landing point of the first virtual object O2, whether the winning or losing of one game of one set has been decided. Then, when the determination is affirmative, the process proceeds to step SP34, and when the determination is negative, the process proceeds to step SP40.

(Step SP34)
The game means 62 adds the score of the player P or the score of the fighting character C according to the result of winning or losing. Then, the process proceeds to the process of step SP36.

(Step SP36)
The game means 62 determines, based on the score of the player P and the score of the opponent character C, whether or not the match (tennis game) has ended. Then, if the determination is affirmative, the series of processes shown in FIG. 4 is terminated, and if the determination is negative, the process proceeds to step SP38.

(Step SP38)
The game means 62 determines whether or not to change the serve right, based on the score of the player P and the score of the opponent character C. If the determination is affirmative, the process proceeds to step SP40, and if the determination is negative, the process returns to step SP10.

(Step SP40)
In step SP32, when the fighting character C hits back the first virtual object O2 (tennis ball) and the game is continued, the control means 68 controls the ejection means 46 to direct it toward the front side of the screen 10A. A second real object similar to the one real object O1 is emitted. Here, the control unit 68 may control the ejection position, the ejection speed, or the ejection direction of the second real object by the ejection unit 46 based on the position information, the velocity information, the direction information, etc. detected by the detection unit 42. .. Further, the control unit 68 may control the ejection position, the ejection speed, or the ejection direction of the second real object by the ejection unit 46 based on the ability of the fighting character C.
Note that the calculated distance from the position where the fighting character C hits the first virtual object O2 in the virtual space to the screen surface in the viewpoint direction, and the actual distance from the ejection means 46 located behind the screen 10A to the screen 10A. The distance is different. Therefore, for example, as shown in FIG. 7, the ejection position and the direction of the second real object O4 by the ejection unit 46 are the same as those of the second virtual object O3 defined as the object in which the first virtual object O2 is returned in the virtual space. On the calculated movement locus L, a position where the actual distance position from the ejection means 46 to the screen 10A and the calculated distance between the second virtual object O2 in the virtual space and the screen surface are the same. The control means 68 controls the ejection means 46 so that the direction becomes the ejection position and the ejection direction. Further, the control means 68 controls the ejection means 46 so that the timing at which the second virtual object O2 reaches this position in the virtual space is the ejection timing. In addition, an effect 14C such as a star may be displayed around the second virtual object O3 according to the battle character C, specifically, the attribute or type of the battle character C. Then, the process proceeds to the process of step SP42.

(Step SP42)
The generation unit 66 generates the image 14A including the second virtual object O3 related to the second real object O4 emitted from the emission unit 46. At this time, the generation unit 66 determines the position of the second virtual object O3 in the virtual space in the image 14A based on the emission position and the emission direction of the second real object O4 by the emission unit 46. Subsequently, the control unit 68 controls the display of the image 14A including the second virtual object O3 generated by the generation unit 66 on the screen 10A using the projection unit 44 until the second real object passes through the screen 10A. .. The second virtual object O3 may be the same as or different from the first virtual object O2. However, from the viewpoint of maintaining continuity, the second virtual object O3 is preferably the same as the first virtual object O2.

FIG. 6(A) continues from FIG. 5(C), and shows an image 14A when the second real object O4 ejected in response to the opponent character C hitting the first virtual object O2 is heading toward the screen 10A. FIG.

As shown in FIG. 6A, since the second real object O4 is located in the depth direction with respect to the screen 10A, it cannot be visually recognized by the player P, but instead, a second virtual object similar to the second real object O4. The object O3 is displayed in the image 14A.

Returning to FIG. 4, the process proceeds to the process of step SP44.

(Step SP44)
The generation unit 66 moves the second virtual object O3 in the image 14A toward the screen 10A based on the ejection speed or the like detected by the detection unit 42. Along with this, the second virtual object O3 displayed on the screen 10A moves.

FIG. 6B is a diagram showing a state of the image 14A and the like immediately after the second real object O4 passes through the screen 10A, following FIG. 6A.

As shown in FIG. 6B, a state in which the second virtual object O3 is moving toward the player P is displayed in the image 14A.

Returning to FIG. 4, the process proceeds to the process of step SP46.

(Step SP46)
The game means 62 determines whether or not the detection means 42 has detected that the second real object O4 has passed the screen 10A. Then, if the determination is affirmative, the process proceeds to step SP48, and if the determination is negative, the process returns to step SP46.

(Step SP48)
The control unit 68 deletes the display of the second virtual object O3 from the image 14A.

FIG. 6C is a diagram showing a state of the image 14A and the like when the second real object O4 passes through the screen 10A, following FIG. 6B.

As shown in FIG. 6C, when the second real object O4 passes through the screen 10A, the display of the second virtual object O3 disappears from the image 14A, and instead, the second real object O4 pops out of the screen 10A. Then, the player P can visually recognize it. At this time, the force from the second real object O4 may act to cause the substance M to scatter in the front direction.

Returning to FIG. 4, the process proceeds to the process of step SP50.

(Step SP50)
The game means 62 determines whether or not the player P has hit back the second real object O4 based on the position information of the second real object O4 detected by the detection means 42, and thus one game of one set. It is determined whether the winning or losing of is confirmed. Specifically, the game means 62 makes an affirmative determination that the win or loss is confirmed when the player P does not hit back the second real object O4, and wins or loses when the player P hits the second real object O4 back. A negative decision is made that it is not finalized. Then, if the determination is affirmative, the process proceeds to step SP52, and if the determination is negative, the process returns to step SP10. In addition, when the second real object O4 is hit back, the second real object O4 is regarded as the first real object O1, and the processing of step SP10 and thereafter is advanced.

(Step SP52)
The game means 62 adds the score of the player P or the score of the fighting character C according to the result of winning or losing. Then, the process proceeds to the process of step SP54.

(Step SP54)
The game means 62 determines, based on the score of the player P and the score of the opponent character C, whether or not the match (tennis game) has ended. Then, when the determination is affirmative, the series of processes shown in FIG. 4 is ended, and when the determination is negative, the process proceeds to the process of step SP56.

(Step SP56)
The game means 62 determines whether or not to change the serve right, based on the score of the player P and the score of the opponent character C. Then, if the determination is affirmative, the process returns to the process of step SP40, and if the determination is negative, the process returns to the process of step SP10. However, when the serve right is changed in step SP38, the above determination is reversed. That is, in such a case, if the above determination is affirmative, the processing returns to the processing of step SP10, and if the above determination is negative, the processing returns to the processing of step SP40.

<Effect>
As described above, in the first embodiment, the imaging system 1 forms the screen 10A by dispersing the substance M in the space, and the first real object O1 when the first real object O1 passes through the screen 10A. Of the virtual object O1 in the virtual space based on the position information detected by the detecting means 42 and the position information detected by the detecting means 42, and an image including the virtual object O1 arranged at the determined position. 14A, and a control means 68 for controlling the display of the image 14A generated by the generation means 66 on the screen 10A when the first real object O1 passes through the screen 10A.

According to this configuration, continuity can be provided between the position of the first real object O1 and the position of the first virtual object O2. Therefore, according to the first embodiment, the reality of the image 14A displayed on the screen 10A can be improved.

Further, in the first embodiment, the detection means 42 further detects the speed information of the first real object O1 when passing through the screen 10A, and the generation means 66 further detects the information detected by the detection means 42. Based on this, the first virtual object O2 in the image 14A is moved.

According to this configuration, continuity can be provided between the direction of the first real object O1 and the moving direction of the first virtual object O2. Therefore, according to the first embodiment, it is possible to further improve the reality of the image 14A displayed on the screen 10A. Further, according to this configuration, it is possible to provide continuity between the speed of the first real object O1 and the speed of the first virtual object O2. Therefore, according to the first embodiment, it is possible to further improve the reality of the image 14A displayed on the screen 10A.

Further, in the first embodiment, the detection means 42 further detects the rotation speed information and/or the rotation direction information of the first real object O1, and the generation means 66 uses the image 14A based on the information detected by the detection means 42. The first virtual object O2 inside is rotated.

According to this configuration, it is possible to provide continuity between the rotation speed and/or the rotation direction of the first real object O1 and the rotation speed and/or the rotation direction of the first virtual object O2. Therefore, according to the first embodiment, it is possible to further improve the reality of the image 14A displayed on the screen 10A.

Further, in the first embodiment, the detection unit 42 further detects the shape information of the first real object O1, and further includes the specifying unit 64 that specifies the first real object O1 based on the shape information detected by the detection unit 42. The generating unit 66 includes, as the image 14A, an image of the virtual object O2 related to the first real object O1 identified by the identifying unit 64.

According to this configuration, it is possible to provide continuity between the type of the first real object O1 and the type of the first virtual object O2. Therefore, according to the first embodiment, it is possible to further improve the reality of the image 14A displayed on the screen 10A.

Further, in the first embodiment, a collecting means 52 for collecting the first real object O1 that has passed through the screen 10A is further provided.

According to this configuration, it is possible to save the trouble of collecting the first actual object O1.

Further, in the first embodiment, there is further provided an ejection unit 46 which is provided in the depth direction of the screen 10A and ejects the second real object O4 toward the front direction of the screen 10A.

According to this configuration, the second real object O4 pops out of the screen 10A, so that the player P can be surprised and enjoyed. Further, according to this configuration, the player P can hit back the second real object O4 that has jumped out, so that the tennis game can be continued.

Further, in the first embodiment, the control unit 68 controls at least one of the ejection position, the ejection speed, and the ejection direction of the second real object O4 by the ejection unit 46.

With this configuration, for example, at least one of the ejection position, the ejection speed, and the ejection direction of the second real object O4 can be controlled according to the progress of the game.

In the first embodiment, the control unit 68 controls at least one of the ejection position, the ejection speed, and the ejection direction of the second real object O4 based on at least the information detected by the detection unit 42.

According to this configuration, continuity can be provided between the first real object O1 and the second real object O4. Therefore, according to the first embodiment, the reality of the game can be improved.

In the first embodiment, the generation unit 66 determines the position of the second virtual object O3 in the virtual space based on the control information (control parameter 60B) of the control unit 68 for the ejection unit 46, and the determined position. The image 14A in which the second virtual object O3 is arranged is generated, and the control means 68 includes the second virtual object O3 generated by the generation means 66 until the second real object O4 passes through the screen 10A. 14A is controlled to be displayed on the screen 10A.

With this configuration, continuity can be provided between the position of the second real object O4 and the position of the second virtual object O3. Therefore, according to the first embodiment, it is possible to further improve the reality of the image 14A displayed on the screen 10A.

Further, in the first embodiment, the game means 62 for advancing the game is further provided, and the generating means 66 generates the image 14A according to the progress of the game.

According to this configuration, since the image 14A corresponds to the progress of the game, it is possible to further improve the reality of the image 14A displayed on the screen 10A.

Further, in the first embodiment, the control unit 68 controls the amount of the substance M sprayed in the forming unit 40 based on the progress of the game.

With this configuration, the player P can see the screen 10A and the image 14A with various atmospheres based on the progress of the game, and thus the interest of the game can be enhanced.

--- Second Embodiment ---
Next, a video system according to the second embodiment of the present invention will be described. The second embodiment is different from the first embodiment in that the game is a fighting game and that it further includes a protrusion means. The other configurations of the video system according to the second embodiment are the same as the configurations of the video system 1 according to the first embodiment.

FIG. 8: is a figure which shows an example of the whole structure of the video system 1A which concerns on 2nd embodiment of this invention.

As shown in FIG. 8, the video system 1A has a configuration similar to that of the first embodiment, and further includes a protrusion means 80. The projecting means 80 is provided in the depth direction of the screen 10A, and projects an object, for example, a game object related to the game, in the front direction from the screen 10A based on the progress of the game. Examples of game objects include artificial faces, feet, hands, insects, water, blood, and the like. When the game object is assumed to be a fluid such as water or blood, the projecting means 80 may be a blower that blows the substance M and projects the substance M from the screen 10A instead of the game object. ..
In the second embodiment, since the game is a fighting game, for example, the player P holds Katana as the first real object O1. Further, a samurai, a zombie, etc. are displayed as the battle character C in the image 14A. In this case, for example, the projecting means 80 projects the game object when the player P defeats the fighting character C, projects the game object when the player P stabs the fighting character C with Katana, or When the game is cleared, the game object is projected.

FIG. 9A is a diagram showing a state of the first virtual object O2 when the player P swings down the katana as the first real object O1 and part of the katana passes through the screen 10A.

As shown in FIG. 9A, the rear end and the central portion of the first real object O1 are visible to the player P as they are, and the tip of the first real object O1 is visible to the player P as the first virtual object O2. Is. Therefore, continuity can be provided between the first real object O1 and the first virtual object O2. Therefore, according to the second embodiment, it is possible to further improve the reality of the image 14A displayed on the screen 10A. Here, when the fighting character C is cut or guarded with a sword, the control means 68 moves the resistance means 50 to the destination of the first real object O1 in order to feed back the feeling to the sword. You may control. In this case, the first real object O1 is resisted by the resistance means 50, and the player P can be given a feeling that the fighting character C is actually guarding.

FIG. 9B is a diagram illustrating a state of the first virtual object O2 when half or more of the first real object O1 passes through the screen 10A, following FIG. 9A.

As shown in FIG. 9(B), the rear end of the first real object O1 can be visually recognized by the player P as it is, and the tip end and the central portion of the first real object O1 can be visually recognized by the player P as the first virtual object O2. It is possible. Further, in the image 14A, blood B spouting from the fighting character C after the tip of the first real object O1 is stuck in the fighting character C is displayed. The blood B may be expressed not only by an image but also by the protrusion means 80 blowing the substance M to cause the substance M to protrude from the screen 10A.

FIG. 9C is a diagram showing a state where the artificial hand H projects from the screen 10A toward the player P, following FIG. 9B.

As shown in FIG. 9C, when the opponent character C is defeated and the game progresses, the projecting means 80 projects the game object H (artificial hand) from the screen 10A.

As described above, in the second embodiment, the image system 1A views the image 14A, the forming unit 40 that distributes the substance M in the space to form the screen 10A, the control unit 68 that controls the display of the image 14A on the screen, and the image 14A. When the opposite side is the depth direction, the projection means 80 is provided in the depth direction of the screen 10A and projects the game object H from the screen 10A in the front direction.

According to this configuration, the game object H projects from the screen 10A, so that the player P can be surprised and enjoyed. Further, it is possible to give the player P a force that cannot be realized only by the image 14A.

--- Modified example ---
The present invention is not limited to the above specific examples. That is, those obtained by appropriately modifying the design of the above specific examples by those skilled in the art are also included in the scope of the present invention as long as they have the features of the present invention. Further, the respective elements included in the above-described embodiment and the modified examples described below can be combined as long as technically possible, and a combination of these is also included in the scope of the present invention as long as it includes the features of the present invention. ..

For example, in the above-described first embodiment, the case where the forming unit 40 sprays one kind of the substance M has been described, but a plurality of kinds of the substance M may be sprayed. Further, the control means 68 may change the type of the substance M sprayed by the forming means 40 according to the progress of the game. For example, the control means 68 changes the substance M to water when the game field is rainy, changes the substance M to paper pieces when the game field is snow, and changes the substance M to sand when the game field is sunny. You may. Further, the forming unit 40 may spray the substances M of a plurality of colors. For example, the forming unit 40 may spray a fluid colored red as the substance M, a fluid colored blue, or a fluid colored green according to the progress of the game.

Further, although the case where the game is a tennis game has been described in the first embodiment and the case where the game is a fighting game has been described in the second embodiment, the game is a golf game, a baseball game, an action game, or a gun. It may be shooting or the like.

FIG. 10A is a diagram showing a state of the image 14A when the player P is playing the golf game. In this case, the first virtual object O2 is a golf ball. FIG. 10B is a diagram showing a state of the image 14A when the player P is playing the baseball game. In this case, the first virtual object O2 is a baseball. In the case of baseball, the fighting character C becomes a pitcher, the ball thrown by the pitcher becomes the second virtual object O2, and the second real object O4 jumps out from the screen 10A toward the player P. At this time, the position and timing of the pitcher throwing the ball, the type of pitch, etc. are determined by the game program or the operation instruction of the opponent player. Therefore, the ejection position and direction of the second real object by the ejection unit 46 are on the calculated movement trajectory of the second virtual object O2, and the actual distance position from the ejection unit 46 to the screen 10A and the virtual space. The control means 68 controls the ejection means 46 so that the position and direction at which the calculated virtual distances of the second virtual object O2 and the screen surface are coincident are the ejection position and the ejection direction. Further, the control means 68 controls the ejection means 46 so that the timing at which the second virtual object O2 reaches this position in the virtual space is the ejection timing.

Further, in the above-described first embodiment, the case where the player P plays the game alone has been described, but the players who are remote may play the same game.

FIG. 11: is a figure which shows an example of the whole structure of the video system 1B which concerns on a modification.

As shown in FIG. 11, the video system 1B includes a plurality of video systems 1 and a server device 90. The plurality of video systems 1 include, for example, the video system 1 on the player P1 side and the video system 1 on the player P2 side. The control means 68 of the terminal device 30A of the one video system 1, the control means 68 of the terminal device 30B of the other video system 1, and the server device 90 communicate with each other via a communication network NT such as an intranet or the internet. Connected possible.

The terminal device 30A and the terminal device 30B are located in a place remote from the place where they are provided and provide the same game to each other. Then, the control unit 68 of the terminal device 30A transmits the information detected by the detection unit 42 to the terminal device 30B via the server device 30. Similarly, the control unit 68 of the terminal device 30B transmits the information detected by the detection unit 42 to the terminal device 30A via the server device 30. Thereby, for example, the position information and speed information of the first real object O1 when the player P1 throws the first real object O1 (baseball) and passes through the screen 10A are transmitted from the terminal device 30A to the terminal device 30B. It Then, the terminal device 30B controls the ejection position, the ejection speed, or the ejection direction of the second real object O4 by the ejection means 46 based on the received information. With this configuration, for example, it is possible to compete with a famous player P1 in a remote place in a form closer to reality.

In addition, the control unit 68 has been described in the case of controlling the display of the image 14A when the first real object O1 passes through the screen 10A, but when the first real object O1 passes through the screen 10A, a sound effect is generated. The output may be controlled. When the first real object O1 passes through the screen 10A, it may be difficult for the player P to hear the sound of the first real object O1. Therefore, the detection means 42 further detects the sound of the first real object O1 when the first real object O1 passes through the screen 10A, and the generation means 66 generates a sound effect based on the detected sound and controls the sound effect. The means 68 may output-control the generated sound effect when the first real object O1 passes through the screen 10A.

Further, the detection unit 42 may detect the head orientation information of the player P, and the control unit 68 may change the display-controlled image 14A according to the orientation information of the head orientation.

Further, if the first real object O1 is held by a hand such as Katana, a vibration member may be provided on the first real object O1. In this case, the control unit 68 may control the vibration member to vibrate when the first real object O1 passes through the screen 10A, when the opponent character C is cut, or when the opponent character C is defeated.

A light emitting member may be provided on the first real object O1. In this case, the control unit 68 may control the light emitting member to emit light when the first real object O1 passes through the screen 10A, when the opponent character C is cut, or when the opponent character C is defeated.

In addition, a cooling member may be newly provided to spray the cooling gas onto the substance M forming the screen 10A to freeze the substance M as the game progresses. As a result, the player P can feel refreshed when the opponent character C is cut.

Further, the forming unit 40 may form two or more screens 10A in the depth direction, and the control unit 68 may control display of different images 14A on each screen 10A. In this case, the player P can enjoy various combinations of the images 14A on each screen 10A.

1, 1A, 1B... Image system 10A... Screen 40... Forming means 42... Detection means 66... Generation means 68... Control means

Claims (2)

Forming means for forming a screen by spraying a substance in a space;
Position information of the real object when the real object passes through the screen, and detection means for detecting shape information of the real object,
Based on the position information detected by the detecting means, a position determining means determines the position of the virtual object in the virtual space, and generating means for generating an image including the virtual object arranged at the determined position,
Control means for controlling the display of the image generated by the generation means on the screen when the real object passes through the screen;
Specifying means for specifying the real object based on the shape information detected by the detecting means,
Equipped with
The generation unit generates, as the image, an image of the virtual object related to the identified real object,
Video system. Position information of the real object when the real object passes through a screen formed by spraying a substance in space, and a computer connectable to detection means for detecting shape information of the real object,
Generating means for determining a position of the virtual object in the virtual space based on the position information detected by the detecting means, and generating an image including the virtual object arranged at the determined position;
Control means for controlling the display of the image generated by the generation means on the screen when the real object passes through the screen,
Specifying means for specifying the real object based on the shape information detected by the detecting means,
Function as
The generation unit generates, as the image, an image of the virtual object related to the identified real object,
Video program.

Images