JP7765076B2 - Game systems and toy sets - Google Patents

Description

The present invention relates to a program, a toy, and a toy set.

Conventionally, there is known a game device in which the aim on the display is controlled based on the positional relationship between a camera attached to a simulated gun that the user holds and moves, and a marker fixedly positioned on the display in front of the user, which is imaged by the camera (see, for example, Patent Document 1).

Patent No. 3626711

The game device described in Patent Document 1 allows users to simulate the game's effects by holding and manipulating a simulated gun, making it highly playable. However, the game device described in Patent Document 1 is limited to users who can hold and freely manipulate a simulated gun that is as heavy as a camera, making it difficult for infants and young children to play casually.

Furthermore, because the game device described in Patent Document 1 is a stationary type, players must go to the installation location each time they want to play, making it difficult to play casually. Since infants and young children in particular prefer to play with their guardians, it is difficult for them to play casually if their guardians are busy.

Small toys such as models, dolls, and blocks for infants and children can be played with intuitively and easily, but due to their simple structure, they cannot be said to have a high level of playability.

The present invention was made with this in mind, and its purpose is to provide a program or the like that can add a high level of playfulness to a toy that is usually played with casually.

One aspect of the present invention is characterized in that a mobile terminal device equipped with a display unit and an imaging unit displays computer game objects on the display unit, reads markers attached to a toy that a user holds and moves using the fixedly positioned imaging unit as needed, and executes processing related to the computer game based on the read and moved markers and the objects.

One aspect of the present invention is to provide a highly playful toy that is easy to play with.

1 is a schematic diagram showing a configuration of a toy system according to an embodiment; 1 is a block diagram showing a configuration of a mobile terminal device according to an embodiment; FIG. 2 is a block diagram showing a configuration of a server according to the embodiment. FIG. 2 is a conceptual diagram illustrating processing related to a program according to an embodiment. FIG. 2 is a conceptual diagram illustrating processing related to a program according to an embodiment. FIG. 10 is a conceptual diagram illustrating a process related to a shooting game. FIG. 10 is a conceptual diagram illustrating a process related to a shooting game. 10 is a flowchart showing a processing procedure of a program according to an embodiment. FIG. 10 is a conceptual diagram illustrating processing related to a spaceship operation game. 10 is a flowchart showing the procedure of processing of a program according to the second embodiment. FIG. 10 is a conceptual diagram illustrating a process related to a calculation game. 11 is a flowchart showing the procedure of processing of a program according to the third embodiment. FIG. 10 is a conceptual diagram illustrating the processing of a program according to a fourth embodiment. 10 is a flowchart showing the procedure of processing of a program according to a fourth embodiment. FIG. 13 is a conceptual diagram illustrating the processing of a program according to a fifth embodiment. 13 is a flowchart showing the procedure of processing of a program according to the fifth embodiment. 10 is a flowchart showing the procedure of processing of a subroutine relating to a first state. 10 is a flowchart showing the procedure of processing of a subroutine relating to a second state.

First Embodiment
A toy system according to an embodiment will be described in detail below with reference to the drawings. Fig. 1 is a schematic diagram showing the configuration of a toy system 100 according to an embodiment. The toy system 100 includes a mobile terminal device 1, a toy 2, and a server computer 3 (hereinafter referred to as "server 3").

The mobile terminal device 1 and server 3 are connected for communication via a network NW such as the Internet. While one mobile terminal device 1 is shown in the diagram, this is not limiting.

For example, multiple mobile terminal devices 1 may be provided. In such a case, the multiple mobile terminal devices 1 may be communicatively connected to each other via a network NW.

In the toy system 100, the server 3 reads the game program and transmits it to the mobile terminal device 1. The mobile terminal device 1 launches the game program, etc., via the web browser 141 or application software.

The mobile terminal device 1 displays an object 91 of the game program on the display unit 14 of the mobile terminal device 1. The mobile terminal device 1 constantly reads a marker 221 attached to a toy 2 that the user holds and moves, via the fixedly placed imaging unit 15 of the mobile terminal device 1.

The mobile terminal device 1 executes processing related to the game program based on the coordinates of the marker 221 that is read and moves.

As a result, in the toy system 100, when the user grips and operates the toy 2, the coordinates corresponding to the marker 221 move, allowing the user to operate the object 91 of the computer game 90 in accordance with the movement of the marker 221, thereby providing a simulated experience of the game space. The toy system 100 provides the toy 2 with a high level of playability.

The configuration of toy 2 in the figure will now be described. In this embodiment, toy 2 is a toy that is held and moved by the user, and has markers 221 attached to it. Toy 2 is a small toy manufactured, for example, by resin molding.

Toy 2 is, for example, a toy for infants and children, such as a toy gun, a toy spaceship model, a toy doll, or a toy racket, which is a general-purpose toy distributed as a prize or promotional item. Toy 2 is not limited to these, and may also be a specialized toy.

The toy 2 comprises a main body 20, a grip 21, and a marker 221. The main body 20 has a weight and size that allows it to be held and moved by infants and children. The grip 21 is provided on the main body 20 and has a shape that makes it easy for infants and children to hold. The grip 21 makes it easy to move the toy 2 when held, although parts other than the grip 21 may also be held.

The marker 221 is attached to the muzzle of a toy gun, for example, and when read by the imaging unit 15 of the mobile terminal device 1, it triggers effects in the computer game 90.

The marker 221 has a design for the effects of the computer game 90. The design refers to an optically recognizable means of communication such as figures, letters, and symbols. The marker 221 is not limited to being made of paper or resin, and may be made of any material that can be read by the device.

In the figure, an example is shown in which the marker 221 is attached to the main body 20, but this is not limited to this and the marker 221 may be printed or engraved on the main body 20. In the figure, an example is shown in which the marker 221 is attached to the main body 20, but in consideration of damage or loss of the marker 221, a spare marker 221 may be attached to the packaging container of the toy 2 or to the enclosed paper. Other forms of the marker 221 will be described later.

Figure 2 is a block diagram showing the configuration of a mobile terminal device 1 according to an embodiment. The mobile terminal device 1 may be a portable smartphone, tablet device, smartwatch device, wearable device, or other computer.

The mobile terminal device 1 includes a control unit 10, a main memory unit 11, a ROM (Read Only Memory) 12, a wireless communication unit 13, a display unit 14, an imaging unit 15, an operation unit 16, a microphone 17, and a speaker 18.

The control unit 10 includes a processing unit such as a CPU (Central Processing Unit) or a GPU (Graphics Processing Unit), a timer, etc. The control unit 10 executes various control processes, information processing, etc. in accordance with commands from the control program P1 stored in ROM 12 and the web browser 141, etc.

The main memory unit 11 is a temporary storage area such as SRAM (Static Random Access Memory) or DRAM (Dynamic Random Access Memory), and temporarily stores data generated when the control unit 10 executes processing.

ROM 12 is a non-volatile memory area and internal storage that stores the control program P1, web browser 141, other application software, and various data. ROM 12 is not limited to this, and may also be an external semiconductor memory (not shown) that can be read by the mobile terminal device 1.

The web browser 141 is application software for rendering scenes including objects 91 of the computer game 90 of the game program.

The control program P1 is a program for controlling the display unit 14, the imaging unit 15, and various other controls. The various data includes the mobile terminal device 1's unique ID, user and owner information, etc.

For example, the mobile terminal device 1 launches a game program or the like received from the server 3, expands it in the main memory unit 11, and executes processing related to the game program or the like by running a Java applet or the like on the web browser 141.

The wireless communication unit 13 is a communication module for executing processing related to wireless communication. The wireless communication unit 13 includes a voice communication unit 131 for voice calls and a data communication unit 132 for sending and receiving data.

The voice communication unit 131 establishes a call connection with other mobile terminal devices 1 via a voice communication line VN. The data communication unit 132 establishes a communication connection with external parties, including the server 3, via the network NW.

The wireless communication unit 13 may include a short-range wireless communication unit 133. The short-range wireless communication unit 133 performs wireless communication using, for example, NFC (Near Field Communication) and reads and writes data to and from an NFC tag with a built-in IC chip. Wireless communication may also be performed using Wi-Fi (registered trademark) or Bluetooth (registered trademark).

The display unit 14 is a liquid crystal display, an organic EL (Electro Luminescence) display, or the like, and sequentially displays multiple scenes including the object 91 of the computer game 90. The display unit 14 dynamically displays the effects of the object 91 of the computer game 90 by sequentially displaying multiple different scenes.

The imaging unit 15 is a small camera equipped with an imaging element such as a CMOS (Complementary MOS) sensor and captures images. The imaging unit 15 sends the captured images to the control unit 10. The imaging unit 15 is, for example, built into the main body of the mobile terminal device 1. However, the imaging unit 15 is not limited to this and may also be externally attached.

In this embodiment, the imaging unit 15 is fixed in position and reads the marker 221 attached to the movable toy 2. For example, the imaging unit 15 is fixed in position when the mobile terminal device 1 is held by the user and held still in the air, and the fixedly positioned imaging unit 15 reads the marker 221 attached to the movable toy 2.

For example, when the mobile terminal device 1 is placed on a desk with the display unit 14 facing upwards, the imaging unit 15 is fixed in place, and the fixed imaging unit 15 reads the marker 221 attached to the movable toy 2.

For example, the mobile terminal device 1 is placed against a wall or a stand, so that the imaging unit 15 is fixed in place, and the fixed imaging unit 15 reads the marker 221 attached to the movable toy 2.

The imaging unit 15 reads the moving marker 221 while it is fixed in place. The mobile terminal device 1 detects the position or movement of the marker 221 through the imaging unit 15 reading the marker 221. However, the mobile terminal device 1 is not limited to this, and may also detect the attitude, including the tilt, of the marker 221, or the distance to the marker 221.

The figure shows an example in which the imaging unit 15 consists of a single camera, but this is not limited to this and multiple cameras may be included. The imaging unit 15 may also include an infrared sensor, a ToF (Time Of Flight) sensor, or a LiDAR (Light Detection And Ranging) sensor to improve distance measurement.

The imaging unit 15 includes, for example, an in-camera 151 arranged on the display unit 14 side of the mobile terminal device 1, and an out-camera 152 arranged on the opposite side of the in-camera 151. The in-camera 151 is used for taking selfies, video calls, etc. While the figure shows an example in which the in-camera 151 reads the marker 221 on the toy 2, this is not limiting, and the out-camera 152 may also read the marker 221 on the toy 2.

The operation unit 16 is an input interface that accepts operations from the owner of the mobile terminal device 1 or the user of the toy 2 and sends them to the control unit 10. The operation unit 16 is, for example, a touch panel integrated with the display unit 14, and accepts operations via a displayed soft keyboard, cursor, etc.

The operation unit 16 is not limited to this, and may also include a mechanical keyboard and a pointing device. The microphone 17 receives voices from calls and computer game 90 operations and sends them to the control unit 10.

The speaker 18 outputs sounds for calls and computer games 90. The mobile terminal device 1 may also be equipped with a GPS (Global Positioning System) unit, a biometric authentication sensor, and other units.

Figure 3 is a block diagram showing the configuration of the server 3 according to the embodiment. The server 3 causes the mobile terminal device 1 to execute processing related to each of the multiple game programs 321 and processing related to the program according to the embodiment.

Server 3 may be a server computer or a personal computer, or may be a cloud computer. In this embodiment, server 3 is an example of a cloud server that provides ASP (Application Service Provider) services.

The mobile terminal device 1 displays the effects of the computer game 90 based on the game program 321 etc. received from the server 3 via the web browser 141 etc. The figure shows an example in which one server 3 performs the processing, but this is not limited to this, and processing may be performed in a distributed manner across multiple servers 3.

The server 3 includes a control unit 30, a main memory unit 31, an auxiliary memory unit 32, and a communication unit 33. The control unit 30 includes a processing unit such as a CPU (Central Processing Unit), an MPU (Micro Processing Unit), or a GPU (Graphics Processing Unit), a timer, etc., and executes various information processing or control processes, etc., in accordance with the instructions of the control program P2, game program 321, and the program related to the embodiment, which are stored in the auxiliary memory unit 32.

The main memory unit 31 is a temporary storage area such as SRAM (Static Random Access Memory), DRAM (Dynamic Random Access Memory), or flash memory, and temporarily stores data generated when the control unit 30 executes processing.

The auxiliary memory unit 32 is a non-volatile storage area such as a hard disk or SSD (Solid State Drive), and stores the control program P2, the game program 321, programs related to the embodiment, and various data.

The game program 321 includes, for example, game scene data 322, game object data 323, texture data 324, effect data 325, sound data 326, and various components 327. Details of these will be provided later.

The control program P2, game program 321, programs related to the embodiment, and various data may be recorded on portable recording medium M1 or semiconductor memory M2, read out via a reading unit, and stored in auxiliary storage unit 32. They may also be downloaded from an external device connected via network NW and stored in auxiliary storage unit 32.

The communication unit 33 is a communication module for executing processes for connecting and communicating with external devices, including the mobile terminal device 1, via the network NW. The server 3 may also include a display unit, an operation unit, and a reading unit (not shown).

The server 3 having the above configuration causes the mobile terminal device 1 to execute processing related to the program according to the embodiment and processing related to the computer game 90. Figures 4 and 5 are conceptual diagrams illustrating processing related to the program according to the embodiment.

Figure 4A illustrates an example of a request being made by transmitting a signal based on a touch operation on the operation unit 16 of the mobile terminal device 1 to the server 3. The server 3 reads the game program 321 and other data from the auxiliary storage unit 32 in response to the request from the mobile terminal device 1.

Figure 4B illustrates an example in which the server 3 reads out a requested game program 321 in response to a request for one of multiple game programs 321.

However, the server 3 is not limited to this, and may also read a portal site for multiple game program titles 321 in response to a request from the mobile terminal device 1, and read the game program 321 selected through the portal site.

The server 3 transmits the read game program 321, etc. to the mobile terminal device 1. The mobile terminal device 1 launches the game program 321, etc. received via the web browser 141, etc., and, in accordance with the instructions of the launched game program 321, etc., matches the world coordinate system C1 of the game program 321 with the screen coordinate system C2 of the display unit 14 of the mobile terminal device 1 and the marker coordinate system C3 of the marker 221, as shown in Figure 4C.

Figure 4C shows an example of matching two-dimensional coordinate systems, but this is not limited to this and three-dimensional coordinate systems may also be matched.

As shown in Figure 4C, the mobile terminal device 1 aligns the origin O of the coordinate systems while capturing an image of the marker 221 with the imaging unit 15. Next, when moving from the origin O to a predetermined destination position P, the mobile terminal device 1 performs preprocessing such as enlarging, reducing, moving, and rotating each of these coordinate systems to match the coordinates of the destination position P in one coordinate system and the coordinates of the destination position P in the other coordinate system so that they are the same.

The marker coordinate system C3 indicates the coordinates of the position of the marker 221 when the image captured by the imaging unit 15 is taken as a whole. The position of the marker 221 is detected based on pixel features of the captured image. The world coordinate system C1 indicates the coordinates of the position of the object 91 when the scene 92 of the computer game 90 is taken as a whole.

The position of object 91 is detected based on pixel features of the displayed image of scene 92. Screen coordinate system C2 is superimposed on the screen of display unit 14 and indicates the coordinates of the position of marker 221 and the coordinates of the position of object 91 when the screen of display unit 14 is taken as the entire screen.

By performing the above matching, the marker 221 moves in the same manner in both the marker coordinate system C3 and the screen coordinate system C2.

The mobile terminal device 1 executes various information processes, etc., in accordance with the commands of the game program 321. The game program 321 generates a scene 92 for the computer game 90 based on the game scene data 322.

The game program 321 generates a scene 92 in which one or more objects 91 are placed based on game object data 323. The game program 321 attaches various components 327 to the object 91, thereby imparting, for example, the texture of the texture data 324 and the effects of the effect data 325 to the object 91.

Textures give object 91 the feel of, for example, paper, wood, or metal. Effects give object 91 a wide variety of effects, such as a bullet impact, a target tilting, a moving object being guided, objects colliding with each other, a fire, smoke being emitted, an object exploding, numbers protruding, a fishing hook being thrown, etc.

By attaching various components 327 to the object 91, other properties, functions, or physical behaviors may be imparted to the object 91. This will enrich the presentation of the object 91 and improve playability. For example, the sound of the sound data 326 may be imparted to the object 91. This will impart sound effects to the object 91, improving playability.

The mobile terminal device 1 displays a scene 92 including an object 91 of a computer game 90 on the display unit 14 based on the matched screen coordinate system C2 and world coordinate system C1.

The mobile terminal device 1 displays the rendering of an object 91 in a computer game 90, which changes by sequentially drawing each of a plurality of scenes 92 in a web browser 141. The user can render the object 91 in the virtual space of the computer game 90 by moving the marker 221 of the toy 2, which exists in real space, creating a sense of realism.

The mobile terminal device 1 reads the marker 221 on the toy 2 held by the user through the fixedly positioned imaging unit 15.

Based on the data of the read marker 221, the mobile terminal device 1 specifies the position of the marker 221 in the matching marker coordinate system C3 and screen coordinate system C2.

The mobile terminal device 1 generates a scene 92 in which an icon indicating the position of the specified marker 221 is placed, and displays the scene 92 including the generated icon on the display unit 14.

Then, the mobile terminal device 1 detects the relationship between the position of the marker 221 specified in the matched marker coordinate system C3 and screen coordinate system C2, and the position of the object 91 specified in the screen coordinate system C2 and world coordinate system C1, and executes processing related to the computer game 90 according to the detection results.

Next, processing related to computer game 90 will be explained. Since computer game 90 has multiple different contents, processing related to computer game 90 will be explained below using a shooting game as an example. Figures 6 and 7 are conceptual diagrams explaining processing related to a shooting game.

The mobile terminal device 1 generates a scene 92 including a target ta (object 91) in accordance with commands from the shooting game (computer game 90) and displays the generated scene 92 on the display unit 14.

The figure shows an example of a scene 92 in which targets ta, resembling multiple beverage cans, are arranged in a horizontal row. Note that the targets ta are not limited to a shape resembling a beverage can, and may be of other shapes. The mobile terminal device 1 reads the moving markers 221 as needed using the fixedly positioned imaging unit 15.

In the figure, the toy 2 is a toy gun, and an example is shown in which the marker 221 is affixed to the muzzle of the main body 20 of the toy gun. Based on the data of the read marker 221, the mobile terminal device 1 performs a hit determination to determine whether the position of the marker 221 specified in the matching marker coordinate system C3 and screen coordinate system C2, i.e., the aim of the toy gun, matches the position of the target ta specified in the screen coordinate system C2 and world coordinate system C1.

The mobile terminal device 1 performs a hit detection based on the game program 321. In the figure, a hit is detected by determining whether the coordinates of the icon i representing the marker 221 match any of the coordinates within the rectangular area representing the target ta.

The hit detection is not limited to this, but includes multiple types of hit detection, such as point-to-point coincidence, point-to-line segment coincidence, point-to-circle coincidence, circle-to-circle coincidence, rectangle-to-rectangle coincidence, and circle-to-line segment coincidence, depending on the shape of the icon i or target ta.

For example, a hit is determined when the position of the marker 221 exactly matches the position of the object 91, but this is not limited to this. A hit may also be determined when the position of the marker 221 matches any coordinate within a predetermined area centered on the position of the object 91.

This allows the game to be run with a lower level of difficulty depending on the dexterity of the infant or child. The criteria for whether these levels match are specified in the game program 321.

If the mobile terminal device 1 determines that there is a match, it outputs an event (request signal) triggered (conditioned) by the position match. The mobile terminal device 1 executes processing related to the computer game 90 that corresponds to the output event.

The association between triggers and events is defined in the game program 321. The mobile terminal device 1 outputs events corresponding to triggers based on the game program 321.

The figure shows an example in which the mobile terminal device 1 outputs an event in which the icon i changes from a dot shape to a cross shape to notify the user that the target ta has been captured with the aim. This embodiment is not limited to this, and other events in which the icon i changes may also be used, or an event in which the background changes instead of the icon i. It is also possible for the icon i to not change even when the target ta has been captured with the aim.

The mobile terminal device 1 uses the timer in the control unit 10 to measure the elapsed time from when a match is determined, and when the elapsed time reaches a predetermined time, this triggers an event that transitions the target ta from an upright position to a backward leaning position, as shown in Figure 7.

The mobile terminal device 1 generates a scene 92 including the tilted target ta in accordance with the event and displays the generated scene 92 on the display unit 14.

Figure 7 shows an example of outputting an event in which the target ta transitions to a tilted state, but this is not limited to this. For example, an event in which the target ta transitions to an explosion state or an event in which the target ta transitions to a rotation state may also be output.

The mobile terminal device 1 repeats hit detection, and when all targets ta transition to a tilted state, it triggers an event to end the game, and ends the computer game 90 being executed in accordance with the event. Prior to ending the game, the mobile terminal device 1 may display an end notice screen on the display unit 14 of the mobile terminal device 1.

In addition to this, a timer in the control unit 10 can be used to measure the time elapsed since the start of play, and when the elapsed time reaches a predetermined play time limit, this can be used as a trigger to output an event to end the game.

The play time limit is set to, for example, 60 seconds from the start of play. This prevents infants and children from becoming absorbed in the game. The mobile terminal device 1 may resume the computer game 90 in response to receiving a touch operation on the operation unit 16.

When the number of times the computer game 90 has been played in a day reaches the play limit, the mobile terminal device 1 may use this as a trigger to output an event that denies resumption of the computer game 90.

The processing steps of the program according to the embodiment are explained below. Figure 8 is a flowchart showing the processing steps of the program according to the embodiment.

The control unit 10 of the mobile terminal device 1 reads the marker 221 of the toy 2 at any time via the fixedly positioned imaging unit 15 (step S101).

The control unit 10 specifies the position of the marker 221 in the marker coordinate system C3 and the screen coordinate system C2 based on the data of the read marker 221 (step S102). The control unit 10 displays an icon i on the display unit 14 based on the specified position of the marker 221.

The control unit 10 performs a collision determination to determine whether the position of the marker 221 specified in the marker coordinate system C3 and the screen coordinate system C2 coincides with the position of the object 91 specified in the screen coordinate system C2 and the world coordinate system C1 (step S103).

If the control unit 10 determines that there is no match (NO in step S103), it returns to step S101 and reads the marker 221 again. On the other hand, if the control unit 10 determines that there is a match (YES in step S103), it outputs an event triggered by the match between the position of the marker 221 and the position of the object 91 based on the game program 321 (step S104).

The control unit 10 changes the shape of icon i from a dot to a cross shape based on the output event (step S105). The control unit 10 executes processing related to the computer game 90 that corresponds to the output event (step S106), and ends the series of processes. Note that step S105, in which icon i is changed from a dot to a cross shape, is an example and is not limited to this.

Furthermore, in embodiment 1, a world coordinate system C1, etc. is matched, and a collision detection is performed between the position of the marker 221 and the position of the object 91 through the matched world coordinate system C1, etc., but this is not limited to this.

Processing may be performed based on the positional relationship between the coordinates of the marker 221 on the display unit 14 and the coordinates of the object 91 on the display unit 14. For example, the control unit 10 acquires an image including the marker 221 via the imaging unit 15.

The control unit 10 determines whether the acquired marker 221 matches a marker 221 previously stored in the ROM 12. If the control unit 10 determines that there is no match, it determines that the marker 221 does not correspond to another computer game 90 and terminates processing.

On the other hand, if the control unit 10 determines that there is a match, it determines that the marker 221 corresponds to the computer game 90 currently being played, and identifies the coordinates of the marker 221 on the display unit 14.

The control unit 10 determines whether the coordinates of the identified marker 221 are included in the coordinate area of the object 91 on the display unit 14. If the control unit 10 determines that they are included, it performs a collision determination and executes an action such as tilting the object 91 on the display unit 14.

At that time, the control unit 10 superimposes an image of icon i corresponding to the marker 221 on the object 91. On the other hand, if the control unit 10 determines that the marker is not included, it determines that there is no hit on the object 91 and continues the process of acquiring an image including the marker 221.

Note that the above describes one example of identifying two-dimensional coordinates on the display unit 14, but this is not limiting. For example, three-dimensional coordinates of the marker 221 on the display unit 14 may be identified, and a hit may be determined if one of the three-dimensional coordinates (the Z coordinate indicating the depth direction) is within a predetermined range and the other two coordinates (the Y coordinate indicating the up-down direction and the X coordinate indicating the left-right direction) are included in the coordinate area of the object 91.

Furthermore, in embodiment 1, an example of a two-dimensional shooting game in which the targets ta are lined up in a row horizontally is shown, but this is not limited to this. For example, a three-dimensional shooting game in which the targets ta are lined up in a row horizontally and in the depth direction may also be used.

Specifically, more advanced effects may be achieved by placing another target ta in the blind spot of one target ta, and when the first target ta tilts, the other target ta is exposed. Furthermore, while a shooting game is described as an example in the first embodiment, this is not a limitation, and computer games 90 other than shooting games may also be used.

Embodiment 2
The second embodiment relates to the execution of processing related to a computer game 90 based on the tilt of a marker 221 .

Below, we will use a spaceship operation game as an example to explain the differences from embodiment 1, and omit the parts that are common to embodiment 1. Figure 9 is a conceptual diagram explaining the processing involved in the spaceship operation game.

In the figure, toy 2 is a spaceship model toy, and an example is shown in which marker 221 is attached to the bottom surface of the main body 20 of the spaceship model toy. Also shown is an example in which the screen scrolls vertically and a scene 92 is displayed on the display unit 14, in which a spaceship ss (object 91) on the screen moves to avoid multiple obstacles ob (object 91).

The mobile terminal device 1 generates a scene 92 in which a moving spaceship and obstacles (objects 91) are placed in accordance with commands from a spaceship operation game (computer game 90), and displays the generated scene 92 on the display unit 14.

The user checks the spaceship ss and multiple obstacles ob displayed on the display unit 14 and controls the spaceship ss by tilting the toy 2 they are holding.

The mobile terminal device 1 detects the tilt of the marker 221 based on the data of the marker 221 read by the imaging unit 15. The tilt of the marker 221 is the rotational movement of the marker 221 around its current position, and is the rotational movement of the marker 221 within a plane that approximately coincides with the tilt of the plane of the display screen of the display unit 14.

The mobile terminal device 1 detects some of the vertices of the design of the rotating and moving marker 221 based on the pixel features of the image captured by the imaging unit 15, and specifies the coordinates of the detected vertices in the marker coordinate system C3.

The figure shows an example of detecting three vertices of marker 221: vertex 221a, vertex 221b, and vertex 221c. The reason three of the four vertices of the rectangle are detected is to make it easier to detect the inclination of marker 221 by making it asymmetric.

The mobile terminal device 1 detects the tilt of the marker 221 by detecting the amount of movement of each of the multiple vertices specified in the marker coordinate system C3. Alternatively, the tilt of the marker 221 may be detected using a learning model that has been trained to output the rotation angle of the marker 221 when image data of the marker 221 is input.

Furthermore, the mobile terminal device 1 may not detect the tilt of the marker 221 if the tilt of the marker 221 is a rotational movement on a plane different from the tilt of the plane of the display screen of the display unit 14. Furthermore, the mobile terminal device 1 may determine that the marker 221 is a rotational movement on a different plane if the distances between the points located at the four corners of the marker 221 are different from each other.

When the mobile terminal device 1 detects the tilt (clockwise) of the marker 221, it triggers an event to output that causes the spaceship ss to turn right and move to the right. Furthermore, when the mobile terminal device 1 detects the tilt (counterclockwise) of the marker 221, it triggers an event to output that causes the spaceship ss to turn left and move to the left.

The mobile terminal device 1 specifies the position of the spaceship ss (one object 91) that has moved in the screen coordinate system C2 and the world coordinate system C1 in accordance with the event. The mobile terminal device 1 performs a collision determination to determine whether the position of the spaceship ss specified in the screen coordinate system C2 and the world coordinate system C1 matches the positions of multiple obstacles ob (other objects 91) also specified in the screen coordinate system C2 and the world coordinate system C1.

The collision detection determines, for example, whether any coordinates within a rectangular area representing the spaceship ss match any coordinates within a rectangular area representing the obstacle ob. If the mobile terminal device 1 determines that there is a match, it triggers an event that causes the spaceship ss to transition to an explosion state.

In response to the event, the mobile terminal device 1 generates a scene 92 in which the spaceship ss is in an exploding state, and displays the generated scene 92 on the display unit 14. However, this is not limited to this, and it may also output an event in which the spaceship ss transitions to an ignition state, or an event in which the spaceship ss transitions to a slow-moving state, etc.

When the spaceship ss transitions to an explosion state, the mobile terminal device 1 uses this as a trigger to output a game end event, and terminates the computer game 90 currently being executed in accordance with the event.

However, without being limited to this, after the spaceship ss transitions to the explosion state, an event may be output in which a remaining spaceship ss appears, the remaining spaceship resumes movement from the explosion position, and the computer game 90 continues. Furthermore, the remaining space may be counted, and when the counted remaining space reaches zero, this may trigger an event to end the game.

In addition to the above example, the position of the moving marker 221 may be recognized in addition to detecting the tilt of the marker 221. For example, the spaceship ss may be caused to rotate in accordance with the tilt of the marker 221, and the spaceship ss may be accelerated or decelerated in accordance with the movement of the marker 221 in the Y-axis direction.

Figure 10 is a flowchart showing the processing steps of the program according to embodiment 2. The control unit 10 of the mobile terminal device 1 reads the marker 221 of the toy 2 at any time via the fixedly positioned imaging unit 15 (step S101).

The control unit 10 detects the tilt of the marker 221 based on the data of the marker 221 that has been read (step S201). The control unit 10 changes the position of one object 91 (spaceship ss) according to the detected tilt of the marker 221 (step S202).

The control unit 10 performs a collision determination to determine whether the changed position of one object 91 (spaceship ss) matches the position of another object 91 (obstacle ob) (step S203). If the control unit 10 determines that they do not match (NO in step S203), it returns to step S101 and reads the marker 221 anew.

On the other hand, if the control unit 10 determines that there is a match (YES in step S203), it outputs an event triggered by the match between the position of one object 91 and the position of another object 91 based on the game program 321 (step S204).

The control unit 10 executes processing related to the computer game 90 corresponding to the output event (step S205), and ends the series of processes. Note that in embodiment 2, a spaceship control game is described as an example, but this is not limited to this, and computer games 90 other than spaceship control games may also be used.

Embodiment 3
The third embodiment relates to the execution of processing related to the computer game 90 based on whether or not the marker 221 can be recognized through the imaging unit 15. In this embodiment, if the marker 221 cannot be recognized through the imaging unit 15, this may be used as a trigger to transition the state of the computer game 90.

Below, we will use a calculation game using arithmetic operations as an example, explaining the differences from embodiment 1 and omitting the parts that are common to embodiment 1. Figure 11 is a conceptual diagram explaining the processing involved in the calculation game.

The mobile terminal device 1 generates a scene 92 in which a calculation problem NC (object 91) based on arithmetic operations is placed in accordance with the commands of the calculation play game (computer game 90), and displays the generated scene 92 on the display unit 14.

In the figure, the toy 2 is a racket-shaped toy, and an example is shown in which the marker 221 is attached to the racket body 20. The mobile terminal device 1 reads the marker 221 on the toy 2 using the fixedly positioned imaging unit 15.

The user moves the toy 2 in their hand to move the marker 221 so that its position is on the display screen of the display unit 14.

The mobile terminal device 1 determines whether the position of the marker 221 is on the display screen of the display unit 14.

When the mobile terminal device 1 determines that the position of the marker 221 is on the display screen of the display unit 14, this triggers the sequential display of multiple answer candidates aw (objects 91) in a specified display area (first state). The figure shows an example of sequentially displaying multiple answer candidates aw in a specified display area by adding 1 to the preceding number, such as the numbers 0, 1, 2, and 3.

However, multiple answer candidates aw may be displayed sequentially by adding a number other than 1 to the preceding number, such as the numbers 0, 1, and 3. Multiple answer candidates aw may also be displayed sequentially at random, such as the numbers 1, 12, 5, and 3. The control unit 10 displays multiple answer candidates aw sequentially while reading the marker 221 continues.

When the answer candidate aw that the user believes to be the correct answer is displayed in the designated display area, if the user moves the marker 221 of the toy 2 outside the area that can be captured by the fixedly positioned imaging unit 15, or turns the racket-shaped toy over onto the side opposite to the side on which the marker 221 is attached, and the marker 221 cannot be recognized by the imaging unit 15, the mobile terminal device 1 transitions from the first state to a state (second state) in which the sequential display of multiple answer candidates aw in the designated display area is stopped.

Outside the imageable area means, for example, going beyond the imaging performance limit area (e.g., angle of view) of the imaging unit 15.

When the mobile terminal device 1 is no longer able to recognize the marker 221 on the toy 2 using the fixedly positioned imaging unit 15, this triggers the device to stop sequentially displaying the multiple answer candidates aw, and compares the stopped answer candidates aw with the correct answer to the calculation problem nc.

The match is performed, for example, by referencing correct answer data (not shown) held by the server 3. In the figure, if the mobile terminal device 1 matches the correct answer, the number 3, it displays a notification display "in" on the display unit 14 congratulating the user for the correct answer. On the other hand, if the mobile terminal device 1 does not match the correct answer, it displays a notification display "in" on the display unit 14 urging the user to reconsider.

In addition to the above example, the toy 2 may be moved so that the display surface of the marker 221 does not face the imaging unit 15, for example by laying the racket body 20 down, thereby placing the marker 221 outside the imaging area of the imaging unit 15.

Furthermore, the marker 221 on the racket body 20 may be outside the imaging area of the imaging unit 15 by moving it outside the angle of view that the imaging unit 15 can provide.

Figure 12 is a flowchart showing the processing steps of the program according to embodiment 3. The control unit 10 of the mobile terminal device 1 reads the marker 221 of the toy 2 at any time via the fixedly positioned imaging unit 15 (step S101).

The control unit 10 outputs an event triggered by reading the marker 221, and transitions the computer game 90 to the first state in response to the output event (step S301).

The control unit 10 determines whether the marker 221 has been recognized through the imaging unit 15 (step S302). Specifically, the control unit 10 determines whether the marker 221 has been recognized through the imaging unit 15, or whether the coordinates corresponding to the recognized marker 221 are within a predetermined area. If the control unit 10 determines that the marker 221 has been recognized (YES in step S302), the process returns to step S301 and the first state continues.

If the control unit 10 determines that the marker 221 has not been recognized (NO in step S302), it transitions the computer game 90 to the second state (step S303) and ends the series of processes.

This embodiment is not limited to this, and the control unit 10 may transition the computer game 90 to the second state in response to a determination that the marker 221 has not been recognized, and then transition the computer game 90 to the first state if the marker 221 moves again into the imageable area of the imaging unit 15, thereby determining that the marker 221 has been recognized.

The figure also shows, as an example, a transition from a state in which multiple answer candidates aw are displayed sequentially in a designated display area (first state) to a state in which the sequential display of multiple answer candidates aw in the designated display area is stopped (second state), but this is not limited to this.

For example, the numbers of multiple answer candidates aw are arranged horizontally in advance and displayed on the display screen of the display unit 14. If the control unit 10 can recognize the marker 221, it puts the device in a state (first state) in which one of the arranged numbers can be selected. The user moves the marker 221 attached to the toy 2 to select the number corresponding to the position of the marker 221 on the display screen of the display unit 14.

Next, if the marker 221 cannot be recognized by, for example, laying the racket-shaped toy down, this triggers a transition to a state (second state) in which the numbers of the selected answer candidate aw are compared with the correct answer to the calculation problem nc. If the correct answer is matched, the control unit 10 displays a notification display in on the display unit 14 congratulating the correct answer; if the correct answer is not matched, the control unit 10 displays a notification display in on the display unit 14 urging the player to reconsider. This allows for a calculation game with a different feel from the calculation game in which the player selects numbers displayed sequentially in a specified display area. Furthermore, although a calculation game is described as an example in the third embodiment, the present invention is not limited to this, and computer games 90 other than calculation games may also be used.

Embodiment 4
The fourth embodiment relates to access to a portal site of a computer game 90 using a two-dimensional code attached to the main body 20 of the toy 2. In this embodiment, the portal site of the computer game 90 may be accessed using the two-dimensional code attached to the main body 20 of the toy 2.

Below, using a toy set consisting of a toy gun and a model toy spaceship as an example, we will explain the differences from embodiment 1 and omit the parts that are common to embodiment 1. Figure 13 is a conceptual diagram that explains the processing of the program related to embodiment 4.

The toy set 50 is sold as a combination of multiple types of toys 2, for example, a combination of a toy pistol as the first toy 2A and a model toy spaceship as the second toy 2B. The figure shows an example in which multiple toys 2 are each packaged in a packaging bag 50A and a packaging bag 50B, but this is not limited to this and multiple toys 2 may be packaged in a single packaging bag. Furthermore, the toys are not limited to packaging bags and may be packaged in a packaging container such as a paper box.

In the first toy 2A, the marker 221A and two-dimensional code 222A are affixed to the main body 20A of the toy gun, and the spare two-dimensional code 222A is affixed to the packaging bag 50A. In the second toy 2B, the marker 221B and two-dimensional code 222B are similarly affixed to the main body 20B of the spaceship model toy, and the spare two-dimensional code 222B is affixed to the packaging bag 50B.

The figure shows an example in which the marker 221A etc. and the two-dimensional code 222A etc. are separate stickers, but this is not limited to this, and the marker 221A etc. and the two-dimensional code 222A etc. may be combined into a single sticker. Furthermore, the spare two-dimensional code 222A etc. may not be attached to the packaging bag 50A etc.

Two-dimensional codes 222A, etc. are code patterns in which information is coded vertically and horizontally, and which code information for accessing a portal site for a specific computer game 90. Two-dimensional codes 222A, etc. are, for example, QR Code (registered trademark) or Data Matrix (registered trademark).

The mobile information terminal 1 analyzes each of the two-dimensional codes 222A, etc., and obtains information for accessing the portal site from each of the two-dimensional codes 222A, etc. The mobile information terminal 1 accesses the portal site via the web browser 141 in accordance with the obtained information.

In this embodiment, analysis of each of the two-dimensional codes 222A, etc. is performed by the mobile terminal device 1, but this is not limited to this; the server 3 may also analyze the two-dimensional codes 222A, etc. received from the mobile terminal device 1. While the figure shows an example of using two-dimensional codes 222A, etc., this is not limiting, and transmission means in which information is coded and optically recognizable may also be used.

The portal site allows the user to select any computer game 90 from among multiple computer game titles 90, such as a shooting game and a spaceship operation game. For example, the user can select any computer game 90 by checking one of the selection boxes for multiple computer game titles 90 on the portal site displayed on the display screen through a touch operation on the operation unit 16 of the mobile information terminal 1.

Access to the game program 321 of the selected computer game 90 is performed, for example, through a deep link described on the portal site.

Deep linking is a technique that uses, for example, a custom URL scheme to define the game program 321 to be launched within the URL of the linked page. However, this is not limited to this, and a universal link may also be used to match the linked web page with the game program 321 to be launched.

The mobile information terminal 1 transmits the selection of the computer game 90 to the server 3 via the deep link, and receives the game program 321 for that computer game 90 from the server 3 in response. The mobile information terminal 1 then launches the received game program 321.

However, this is not a limitation, and the mobile information terminal 1 may assign different URLs to the two-dimensional code 222A and the two-dimensional code 222B, so that the mobile information terminal 1 can immediately receive the computer game 90 corresponding to the URL from the server 3 via the portal site. The portal site data is stored, for example, in the auxiliary storage unit 32 of the server 3. However, this is not a limitation, and the data may also be stored in a device instead of the server 3.

Markers 221A and the like may have different designs depending on the type of computer game 90. The figure shows an example in which marker 221A has a design for a shooting game, and marker 221B has a design for a spaceship control game. The design differs depending on the genre of the computer game 90, such as action, shooting, racing, or puzzle. However, the design is not limited to this, and may also differ depending on the title of the computer game 90.

The mobile information terminal 1 analyzes the design to obtain information corresponding to the type of computer game 90 from each of the markers 221A, etc. The mobile information terminal 1 executes processing related to the computer game 90 based on the obtained information.

The mobile information terminal 1 executes processing related to the shooting game computer game 90, for example, by using the shooting game marker 221A.

Similarly, by using marker 221B for the spaceship operation game, processing related to computer game 90 for the spaceship operation game is executed. On the other hand, when marker 221A for the shooting game is used, mobile information terminal 1 does not execute processing related to computer game 90 for the spaceship operation game.

A single genre may include one computer game 90 title, or multiple computer game 90 titles.

For example, when using a marker 221A corresponding to a first genre, the mobile information terminal 1 executes processing related to a computer game 90 belonging to the first genre, but may not execute processing related to a computer game 90 belonging to a second genre that does not correspond to the first marker 221A.

This prevents a user from playing computer game 90 using toy 2 with an incompatible marker 221 in toy set 50, for example, and prevents playing in a way that differs from the original way of playing assigned to toy 2.

Figure 14 is a flowchart showing the processing steps of a program according to embodiment 4. The control unit 10 of the mobile terminal device 1 reads a two-dimensional code 222A or the like attached to the main body 20A or the like of a toy 2A or the like (step S401).

The control unit 10 acquires information from the read two-dimensional code 222A, etc., and accesses the corresponding portal site. The control unit 10 displays the screen of the accessed portal site on the display unit 14.

The user selects any computer game 90 from the multiple computer game titles 90 included in the displayed portal site by touching the operation unit 16 of the mobile terminal device 1.

The control unit 10 accepts the selection of a computer game 90 in response to a user operation (step S402). After launching the selected computer game 90, the control unit 10 determines whether the marker 221 corresponding to the selected computer game 90 matches the marker 221 read through the imaging unit 15 (step S403). Specifically, the control unit 10 determines whether the marker 221 specified in the computer program 321 matches the marker 221 read through the imaging unit 15.

If the control unit 10 determines that there is a match (YES in step S403), it executes processing related to the selected computer game 90, such as a collision detection between the object 91 and the recognized marker 221 (step S404), and ends the series of processes.

If the control unit 10 determines that there is no match (NO in step S403), it outputs an alert indicating that the markers 221 do not match (step S405) and ends the series of processes.

In addition to the above processing, if it is determined that there is no match, the series of processes may end without outputting an alert indicating that the markers 221 do not match. Also, if it is determined that there is no match, the process may return to step S402 and accept a new selection of a computer game 90. In embodiment 4, a toy set consisting of a toy gun and a spaceship operation game is described as an example, but this is not limited to this and a toy set combining other computer games 90 may also be used.

Fifth embodiment
The fifth embodiment relates to a computer game 90 using a whistle. In this embodiment, the computer game 90 may be played using a whistle.

Below, we will use a computer game 90 using a blowback whistle as an example, and explain the differences from embodiment 1, omitting the parts that are common to embodiment 1. Figure 15 is a conceptual diagram explaining the processing of the program related to embodiment 5.

The mobile terminal device 1 generates a scene 92 in which multiple targets ta (objects 91) and destinations md (objects 91) corresponding to each of the multiple targets ta are arranged in accordance with commands from the computer game 90, and displays the generated scene 92 on the display unit 14.

In the figure, the toy 2 is a whistle, and an example is shown in which the marker 221 is attached to the extendable part of the whistle's main body 20.

By attaching the marker 221 to the tip of the expandable portion, it is exposed when the expandable portion is fully expanded by the user's exhalation (breathing), and is covered when the expandable portion contracts due to an interruption in exhalation. In other words, the marker 221 is exposed when the expandable portion is fully expanded as the user continues to exhale, and is imaged by the imaging unit 15 of the mobile terminal device 1 in the direction extending along the axial direction of the blowback whistle.

The multiple targets ta are made up of multiple types of shapes. A destination md having the same shape is set for each of the multiple targets ta, and each destination md is placed at a predetermined position in the scene 92.

By continuing to exhale, the user extends the retractable portion of the whistle, thereby continuing to expose the marker 221. The mobile terminal device 1 continues to recognize the continuously exposed marker 221 through the imaging unit 15.

The mobile terminal device 1 performs a collision detection between the position of the read marker 221 and the position of the target ta in the scene 92, and identifies the target ta that matches the position of the marker 221. The collision detection is as described above.

The mobile terminal device 1 outputs an event to move the identified target ta, triggered by the identification of the target ta. The user moves the whistle while extending the telescopic part of the whistle, thereby moving the marker 221.

The mobile terminal device 1 reads the moving marker 221 via the imaging unit 15 and, based on the movement of the marker 221, sets the identified target ta in a state (first state) where it is being tracked. That is, the control unit 10 sets the state in which it recognizes the marker 221 as the first state. The mobile terminal device 1 moves the identified target ta to a predetermined destination md, engages it, and completes the movement of the target ta. The mobile terminal device 1 may notify the user that movement to the destination md has been completed.

When the mobile terminal device 1 moves the identified target ta to a predetermined destination md, if it determines that the shape of the target ta differs from the shape of the destination md, it returns the target ta to its original position and marks the movement of the target ta as incomplete. The mobile terminal device 1 reads a new marker 221.

The mobile terminal device 1 repeats the above process until all targets ta have moved to their corresponding destinations md. The mobile terminal device 1 outputs a game end event triggered by the completion of movement of all targets ta to their destinations md, and ends the running computer game 90. Prior to ending the game, the mobile terminal device 1 may notify the user that movement of all targets ta to their destinations md has been completed.

When the user stops breathing out, the telescopic part of the whistle contracts and blocks the marker 221. For example, if the mobile terminal device 1 is in the first state, i.e., if the user stops breathing out while the target ta is moving and the marker 221 is not recognized through the imaging unit 15, the mobile terminal device 1 may transition from the first state to a state (second state) in which the target ta is returned to its original position, and the movement of the target ta may not be completed. In other words, the control unit 10 defines the state in which the marker 221 is recognized as the first state. This encourages the user to continue breathing into the whistle for a longer period of time in an attempt to move the target ta smoothly.

Figure 16 is a flowchart showing the processing steps of the program according to embodiment 5. The user fully extends the retractable portion of the whistle by exhaling, thereby exposing the marker 221 attached to the tip of the retractable portion. The control unit 10 of the mobile terminal device 1 determines whether the exposed marker 221 is recognized via the imaging unit 15 (step S501).

If the control unit 10 determines that the marker 221 is recognized (YES in step S501), it transitions to the first state and executes a subroutine related to the first state (step S502). The processing procedure of the subroutine will be described later.

On the other hand, if the control unit 10 determines that the marker 221 is not recognized (NO in step S501), it transitions to the second state and executes a subroutine related to the second state (step S503). The processing procedure of the subroutine will be described later.

Note that if it is determined in step S502 that the marker 221 is not recognized while the subroutine related to the first state is being executed, the first state may be interrupted and a transition to the second state may be made.

After executing the subroutine related to the first state in step S502, the control unit 10 determines whether the shape of the destination md and the shape of the target ta match (step S504). If the control unit 10 determines that the shape of the destination md and the shape of the target ta do not match (NO in step S504), it transitions to step S503 and executes the subroutine related to the second state.

If the control unit 10 determines that the shape of the destination md matches the shape of the target ta (YES in step S504), it completes the movement of the target ta by fitting the target ta into the destination md. The control unit 10 then determines whether the movement of all targets ta has been completed (step S505).

If the control unit 10 determines that the movement of all targets ta has not been completed (NO in step S505), the process returns to step S501 and reads the next exposed marker 221. Based on the movement of the read marker 221, the user moves the targets ta whose movement has not yet been completed to the destination md.

If the control unit 10 determines that the movement of all targets ta has been completed (YES in step S505), it ends the computer game 90 (step S506) and terminates the series of processes.

Figure 17 is a flowchart showing the processing steps of the subroutine related to the first state. The control unit 10 identifies the target ta corresponding to the position of the marker 221 being recognized (step S601).

The control unit 10 causes the identified target ta to track the movement of the recognized marker 221 (step S602), and ends the series of processes. As described above, if it is determined that the marker 221 is not recognized during execution of the subroutine related to the first state, the first state may be interrupted and a transition to the second state may be made.

Figure 18 is a flowchart showing the processing steps of the subroutine related to the second state. When the control unit 10 determines in step S501 that the marker 221 is not recognized, it suspends the movement of the target ta and returns the target ta to its original position (step S701). The control unit 10 then marks the movement of the target ta as incomplete (step S702) and ends the series of processes.

If it is determined that the marker 221 has been recognized while the subroutine relating to the second state is being executed, the target ta may be returned to its original position and then moved again to the specified destination md.

In embodiment 5, the user keeps the telescopic part of the whistle fully extended for a longer period of time in order to expose the marker 221 and have it recognized by the imaging unit 15, thereby applying strain to the user's respiratory muscles and training their breathing. The computer game 90 according to embodiment 5 has the purpose of training breathing.

In the above embodiment, an example is shown in which one marker 221 is attached to one toy 2, but this is not limited to this, and multiple markers 221 may be attached to one toy 2.

Furthermore, while the above embodiment shows an example in which one toy 2 is used for one computer game 90, this is not limiting, and multiple toys 2 may be used for one computer game 90. This allows multiple users to play in a competitive format.

In addition, while the above-described embodiment shows an example in which one user plays the computer game 90 using one mobile terminal device 1, this is not limiting. Many users may gather together and connect their respective mobile terminal devices 1 via short-range wireless communication, allowing many users to play the computer game 90 in a cooperative manner.

Furthermore, while the above-described embodiments show examples of computer games 90 for recreational purposes, such as shooting and puzzle games, the present invention is not limited to these, and may also include computer games 90 for learning purposes, simulated cooking experiences, simulated crafting experiences, simulated sports experiences, etc.

In this case, the toy 2 may be stationery, cooking utensils, tools, sports equipment, etc., which are not primarily intended for play but can be used in playing the computer game 90.

In addition, the above-described embodiment shows an example in which the marker 221 is attached to the toy 2 and a spare marker 221 is attached to the packaging container of the toy 2 or to the enclosed paper, but this is not limited to this. For example, the marker 221 printed on the packaging container of the toy 2 or to the enclosed paper may be cut out, and the user may attach the cut-out marker 221 to any location on the toy 2.

For example, the user may attach a sticker of the marker 221 to any location on the toy 2. Alternatively, instead of the marker 221, the user may similarly attach a two-dimensional code 222 to any location on the toy 2. Alternatively, the user may attach a sticker of the marker 221 or the two-dimensional code 222 to a substitute for the toy 2, and then grasp and move the substitute to temporarily execute the processing related to the computer game 90 described above.

Furthermore, the above embodiment shows an example in which information corresponding to each type of computer game 90 is obtained from the markers 221 by analyzing the design contained in each of the multiple markers 221, but this is not limited to this. For example, the marker 221 may include a mark indicating the provider of the computer game 90, and the computer game 90 may be playable only when the mark is read.

Furthermore, while the above describes an example in which the program executed by the mobile terminal device 1 is a program separate from the game program 321, this is not limiting, and the above-mentioned program may be incorporated into the game program 321.

The program may also be deployed to run on a single computer, located on a single website, or distributed across multiple websites and executed on multiple computers connected to each other via a communications network.

Furthermore, the embodiments disclosed above should be considered to be illustrative in all respects and not restrictive. Furthermore, the technical features (constituent elements) described in each embodiment can be combined with each other, and when combined, form new technical features.

The scope of the present invention is also intended to include all modifications within the scope of the claims and equivalents to the scope of the claims.

1 Portable terminal device 10 Control unit 11 Main memory unit 12 ROM
13 Wireless communication unit 131 Audio communication unit 132 Data communication unit 133 Short-range wireless communication unit 14 Display unit 141 Web browser 15 Imaging unit 151 In-camera 152 Out-camera 16 Operation unit 17 Microphone 18 Speaker 2 Toy 20 Main body 21 Holding unit 221 Marker 222 Two-dimensional code 3 Server computer 30 Control unit 31 Main memory unit 32 Auxiliary memory unit 321 Game program 322 Game scene data 323 Game object data 324 Texture data 325 Performance data 326 Sound data 327 Various components 33 Communication unit 50 Toy set 90 Computer game 91 Object 92 Scene 100 Toy system

Claims (5)

a marker attached to a tip of a telescopic part of a whistle having an extension part that extends when a user exhales, the marker being exposed when the extension part is extended;
a mobile terminal device including a display unit and an imaging unit ;
The mobile terminal device
displaying a computer game object on the display unit;
when the marker, which is exposed as a result of the extension of the expandable portion due to the user's exhalation, is continuously read by the imaging unit, transitioning the computer game to a first state in which a plurality of selection candidates related to the object are sequentially displayed in a predetermined display area ;
when the user stops exhaling and the expandable portion contracts, blocking the marker and making it impossible for the imaging unit to read the marker, transitioning the computer game to a second state in which the sequential display of the plurality of selection candidates in the predetermined display area is stopped and any one of the selection candidates is displayed in the predetermined display area;
When the state transitions to the second state, the selection candidates displayed in the predetermined display area are compared with the correct answer;
Notify the match result
Game system. a marker attached to a tip of a telescopic part of a whistle having an extension part that extends when a user exhales, the marker being exposed when the extension part is extended;
a mobile terminal device including a display unit and an imaging unit;
The mobile terminal device
displaying a computer game object on the display unit;
when the marker, which is exposed as a result of the extension of the expandable portion due to the user's exhalation, is continuously read through the imaging unit, transitioning the computer game to a first state in which an object displayed on the display unit follows the movement of the marker;
When the user stops breathing in, the expandable portion contracts, shielding the marker and making it impossible for the imaging unit to read the marker, the computer game is transitioned to a second state in which the object is placed in its original position.
Game system. 3. The game system according to claim 1 , wherein a two-dimensional code for accessing a portal site for the computer game is attached to the whistle . The marker has a different design depending on the type of the computer game.
4. A game system according to claim 1. a first toy in which a first marker is attached in an exposed state to a toy body that is held and moved by a user, the first marker being such that when the first marker is read by an imaging unit of a fixedly disposed portable terminal device while a first computer game is running, the first computer game can proceed , but when the first marker is read by the imaging unit while a second computer game different from the first computer game is running, the second computer game cannot proceed;
a second toy, the second marker being attached to the tip of an extendable portion of a whistle having an extendable portion that extends when a user exhales, the second marker allowing the second computer game to progress when the second computer game is running and preventing the first computer game from progressing when the second marker is read through the imaging unit while the first computer game is running, so that the second marker is exposed when the extendable portion is extended .