JP4729604B2 - Image display system, image processing system, recording medium, and program - Google Patents

Description

The present invention captures an image of a card placed on a desk or table, and displays an image that displays a 3D image of an object corresponding to the identification number specified by the identification image attached to the card, along with the captured image. display system, an image processing system and recording medium, and a program for recognition of the card disposed in various.

  Recently, a card with an identification image (such as a two-dimensional barcode) attached to the front or back surface is imaged by, for example, a CCD camera, and the image data of the identification image attached to the card is detected from the image data of the captured image. Patent Document 1 discloses a method for detecting the identification information of the card from the image data of the detected identification image.

  Then, this method is developed to display a captured image including an image of the card from the CCD camera on a monitor, and the detected identification on the image of the card displayed on the monitor An example in which a three-dimensional image of an object corresponding to information is superimposed and displayed is disclosed in Patent Document 2. According to this method, it is possible to express a visual effect that fuses real space and virtual space.

JP 2000-82108 A JP 2000-322602 A

The present invention is to further develop the method of Patent Document 2 described above, various video can be easily applied to a game, expansion of the category of video games, an image display system capable of diversified, image An object is to provide an image processing system , a recording medium, and a program .

An image display system according to a first aspect of the present invention includes a computer, an imaging unit connected to the computer and imaging a plurality of cards each having an identification image attached thereto, and a display device connected to the computer. In the display system, captured image display control means for outputting image data of a captured image including identification images of the plurality of cards from the imaging means to the display device, and displaying the captured image on the display device; Detection means for detecting the image data of each identification image attached to the plurality of cards from the image data of the captured image, and identification information for detecting the identification information of the card from the image data of the identification image detected by the detection means Detecting means; target position setting means for setting a specific target position in the captured image; and identification of the plurality of cards displayed. Object display control means for controlling to superimpose and display an object image corresponding to the card identification information on the image, and displaying the displayed image of the object moving to the specific target position It has object movement display control means to control in this way.
A recording medium according to a second aspect of the present invention includes a computer, an image display unit connected to the computer and configured to image a plurality of cards each having an identification image attached thereto, and a display device connected to the computer. A captured image display control unit configured to output image data of a captured image including identification images of the plurality of cards from the imaging unit to the display device, and to display the captured image on the display device; Detection means for detecting image data of each identification image affixed to the plurality of cards from the image data, identification information detection means for detecting the identification information of the card from the image data of the identification image detected by the detection means, Of the captured images, target position setting means for setting a specific target position, and each of the displayed identification images of the plurality of cards is displayed on the card. Object display control means for controlling to superimpose and display an object image corresponding to the identification information of the object, object movement for controlling to display the displayed image of the object to the specific target position It is a computer-readable recording medium on which a program for functioning as display control means is recorded.
According to a third aspect of the present invention, there is provided an image display system including a computer, an image pickup unit connected to the computer and picking up a plurality of cards each having an identification image attached thereto, and a display device connected to the computer. Output image data of a captured image including identification images of the plurality of cards from the imaging unit to the display device, and a captured image display control unit that displays the captured image on the display device; Detection means for detecting image data of each identification image affixed to the plurality of cards from image data, identification information detection means for detecting identification information of the card from image data of the identification image detected by the detection means, Among the captured images, target position setting means for setting a specific target position, and on the displayed identification images of the plurality of cards, respectively Object display control means for controlling to superimpose and display an image of an object corresponding to the identification information of the mode, and an object for controlling to display the displayed image of the object moving to the specific target position It is a program for functioning as a movement display control means.
In the first to third aspects of the present invention, there is provided second object movement display control means for controlling the image of the object that has moved to the target position so as to perform a display that moves to the position of the identification image of the corresponding card. You may do it.
In the first to third aspects of the present invention, object erasure display control means for controlling to perform display for erasing the image of the object moved to the target position, and card identification information corresponding to the erased object And an identification information invalidating means for invalidating.
In the first to third aspects of the present invention, the target position setting means includes reference image detection means for detecting image data of a predetermined reference image among the captured images, and the reference image detection means The position of the reference image detected by may be set as the specific target position.
In the first to third aspects of the invention, the target position setting means includes means for detecting an arrangement direction of the plurality of cards based on image data of the plurality of identification images detected by the detection means. The specific target position may be set from the arrangement direction of the plurality of cards.
In the first to third aspects of the invention, the target position setting means includes means for detecting an arrangement direction of the plurality of cards based on image data of the plurality of identification images detected by the detection means, and a display. Means for selecting one object among a plurality of detected objects based on the arrangement direction of the plurality of cards detected, and the position of the selected one object as the specific target position You may make it do.
Next, the image processing system according to a fourth aspect of the present invention, a computer and connected to said computer, in the image processing system having an imaging means for imaging the card identification image is attached, the image pickup from the image pickup means Among the images, reference image detection means for detecting image data of a predetermined reference image, and coordinates for obtaining a camera coordinate system of the entire captured image from the position of the image data of the reference image detected by the reference image detection means System conversion means, detection area setting means for setting a specific detection area based on camera coordinates of the image data of the reference image, and image data included in the detection area of the captured image is pasted on the card. Detection means for detecting the image data of the identified image, and identification information of the card from the image data of the identification image detected by the detection means And having an identification information detecting means for detecting.
Recording medium according to the fifth invention, the computer and is connected to the computer, an image processing system having an imaging means for imaging the card identification image is attached, among the captured images from the imaging means, Reference image detection means for detecting image data of a predetermined reference image, coordinate system conversion means for obtaining a camera coordinate system of the entire captured image from a position of image data of the reference image detected by the reference image detection means, Detection area setting means for setting a specific detection area based on the camera coordinates of the image data of the reference image; among the captured images, the image data of the identification image attached to the card from the image data included in the detection area Detection means for detecting, identification information detection means for detecting the identification information of the card from the image data of the identification image detected by the detection means; A computer-readable recording medium having a program recorded thereon for functioning Te.
Program according to the present invention of the sixth computer and is connected to the computer, an image processing system having an imaging means for imaging the card identification image is attached, among the captured images from the imaging means, advance Reference image detection means for detecting image data of the determined reference image, coordinate system conversion means for obtaining a camera coordinate system of the entire captured image from the position of the image data of the reference image detected by the reference image detection means, the reference Detection area setting means for setting a specific detection area based on camera coordinates of image data of an image, and detecting image data of an identification image attached to the card from image data included in the detection area among the captured images Detection means for detecting the identification information of the card from the image data of the identification image detected by the detection means Is a program to function with.
In the fourth to sixth inventions, the specific detection area may be a rectangular area centered on the reference image or a circular area centered on the reference image.
In the fourth to sixth inventions, the identification information detecting means may detect the card identification information by affine transforming the image data of the card identification image detected by the detection means. .
In the present invention, an object corresponding to the identification information of the card is displayed superimposed on the displayed card image. Then, the image of this object moves to a predetermined position on the captured image. For example, in the case of a video game, a display such as a character appearing from a card moving to a predetermined position and performing a battle is performed, which is suitable for a battle game or the like. Here, the character refers to an object that moves, among objects, imitating a human or animal, or a hero appearing in a television program or an animated movie.

  And you may make it perform the display which the said object which moved to the said predetermined position moves on the image of the said card | curd. This is suitable for a case where, when applied to a video game, a display such as a character winning in battle returning to a position on the original card is performed.

  Further, it may be displayed that the object that has moved to the predetermined position disappears at the predetermined position. This is suitable for a display such as a character losing in battle disappearing on the spot.

Further, in this onset bright, if the video game if example embodiment, is performed displays such as battles navigate to the location in which a plurality of objects displayed is specified based on the arrangement direction of the plurality of cards, This case is also suitable for a battle game or the like.

Further, it is possible to display that object which appeared respectively from multiple cards gather in one location specified in the arrangement position of the plurality of cards. In particular, when the plurality of cards are arranged in a circle, it is possible to display that a plurality of objects are gathered at the center position of the circle, which is suitable for a game of three or more players.

As described above, the image display system according to the present invention, images processing system, according to the recording medium, and program, can be easily applied to a variety of video games, expansion of the category of video games, diversification Can be achieved.

Hereinafter, an image display system according to the present invention, images processing system will be described with an embodiment of embodiment applied to a recording medium, and program a video game system with reference to FIGS. 1 to 44.

  As shown in FIG. 1, the video game system 10 according to the present embodiment includes a video game machine 12 and various external devices 14.

  The video game machine 12 exchanges data with a CPU 16 that executes various programs, a main memory 18 that stores various programs and data, an image memory 20 that records (draws) image data, and various external devices 14. And an input / output port 22 for performing the above.

  Various external devices 14 connected to the input / output port 22 include a monitor 30 connected via a display interface (I / F) 28 and an optical disk (DVD-ROM, DVD-RW, DVD-RAM, CD-ROM). Etc.) An optical disk drive 34 for reproducing / recording to / from 32, a memory card 38 connected via a memory card interface (I / F) 36, and a connection via an imaging interface (I / F) 40 A CCD camera 42, a hard disk drive (HDD) 46 that performs reproduction / recording on the hard disk 44, and a speaker 50 connected via an audio interface 48. Of course, the input / output port 22 may be connected to the Internet (not shown) via a router (not shown).

  Data input / output to / from the external device 14 and data processing in the video game machine 12 are performed through the CPU 16 and the main memory 18, and in particular, imaging data and image data are recorded (drawn) in the image memory 20.

  Next, the characteristic functions of the video game system 10 according to the present embodiment, that is, a randomly accessible recording medium such as the optical disk 32, the memory card 38, and the hard disk 44, or the Internet or an intranet, for example. Functions realized by a program provided to the video game machine 12 via the network will be described with reference to FIGS.

  First, the card 54 used in the video game system 10 will be described. This card 54 generally has the same size and thickness as a card used in a card game. As shown in FIG. 2A, a pattern indicating a character corresponding to the card 54 is printed on the front surface, and on the back surface, As shown in FIG. 2B, an identification image 56 is printed. Of course, you can use a transparent card. In this case, only the identification image 56 is printed.

  The identification image 56 is configured by a pattern of a two-dimensional barcode (hereinafter abbreviated as 2D code) as shown in FIG. 2B. In the identification image 56, one block is one unit, the length of the vertical direction is 9.5 blocks, and the length of the horizontal direction is 7 blocks. The blocks are separated. The logo part 58 is a 2D code for notifying the reference position of the code part 60 and the direction of the card 54, and the vertical direction is 1.5 blocks long and the horizontal direction is 7 blocks long. A rectangular black reference cell 62 is arranged. The logo portion 58 may be printed with, for example, a character name or a mark (logo) for advertising.

  The code unit 60 includes, for example, black square corner cells 64 for recognition information recognition corresponding to each corner portion in a square range having a length of 7 blocks in both the vertical direction and the horizontal direction. For example, black rectangular identification cells 66 for recognizing identification information are two-dimensionally patterned and arranged in an area surrounded by four corner cells 64.

  The method for detecting the position of the identification image 56 from the captured image data, the method for detecting the image of the corner cell 64, and the method for detecting the two-dimensional pattern of the identification cell 66 are disclosed in, for example, Patent Document 1 described above (Japanese Patent Laid-Open No. 2000-2000). No. 82108) is described in detail.

  In the present embodiment, the correspondence table between the various patterns of the two-dimensional pattern of the identification cell 66 and the identification numbers corresponding to each pattern is a hard disk 44 as a database 68 (2D code database: see FIGS. 6 and 7), for example. Or the optical disc 32 or the like. Therefore, the identification number of the card 54 can be easily detected by comparing the detected two-dimensional pattern of the identification cell 66 with the correspondence table in the database 68.

  As shown in FIGS. 3A and 3B, the functions realized by the video game system include, for example, six cards 541, 542, 543, 544, 545, and 546 placed on a desk or table 52, etc. And the images of the cards 541, 542, 543, 544, 545 and 546 displayed on the screen of the monitor 30, for example, the cards 541, 542, 543, 544, 545 and the like. On the identification images 561, 562, 563, 564, 565 and 566 affixed to 546, images (701, 702, 703, 704) of objects (characters) corresponding to the identification images 561-566 of the cards 541-546, etc. , 705 and 706 are displayed in a superimposed manner so that the game and the video game are fused. Is that to realize. In the example of FIG. 3A, one user 74A arranges three cards 541 to 543 in a horizontal direction on a desk or table 52, and the other user 74B similarly places three cards 544 to The case where 546 is arranged in the horizontal direction is shown. A character refers to a hero or the like appearing in a human or animal or a television program or an animated movie among objects.

  Further, as shown in FIG. 3A, the CCD camera 42 is attached to a stand 72 fixed on a desk or table 52. At this time, for example, the user 74A and 74B set the imaging surface of the CCD camera 42 to the cards 541 to 541. It is adjusted so as to face the portion where 546 is placed. Of course, as shown in FIG. 4A, when the user 74 captures an image of holding one card 542 and displays it on the monitor 30, the screen of the monitor 30 is displayed on the screen of the user 74 as shown in FIG. 4B. An image, an identification image 562 of the card 542, and a character image 702 are displayed, and a scene where a character is on the card 542 held by the user 74 can also be displayed.

  The above-described functions of the present embodiment are achieved by the CPU 16 executing an application program for realizing the functions among various programs installed in the hard disk 44, for example.

  As shown in FIG. 5, the application program 80 includes a card recognition program 82, a character appearance display program 84, a character action display program 86, a field display program 88, a card position prediction program 90, a combination action display program 92, and a first action program. A character movement display program 94, a second character movement display program 96, a character invalidation program 98, a floating image display program 100, and a landing display program 102 are provided.

  Here, the function of the application program 80 will be described with reference to FIGS.

  First, the card recognition program 82 recognizes an identification image 561 of a card (for example, the card 541 in FIG. 3A) placed on a desk, table 52, or the like, and displays an image of a character (for example, a character to be displayed on the identification image 561). 3B, the image 701) is specified. As shown in FIG. 6, the captured image rendering function 103, the reference cell detection function 104, the identification information detection function 106, the camera coordinate detection function 108, And a character image search function 110. Here, “recognition” indicates that the identification number or direction of the card 541 is detected from the identification image 561 of the card 541 detected from the captured image data drawn in the image memory 20.

  The captured image rendering function 103 sets and renders the captured image of the subject as a background image in the image memory 20. One of the processes to be set as the background image includes setting a Z value for Z buffering.

  As described above, the reference cell detection function 104 detects the image data of the reference cell 62 of the logo portion 58 from the image data (captured image data) drawn in the image memory 20, and the position of the image data of the reference cell 62. Is detected. The position of the image data in the reference cell 62 is detected as screen coordinates.

  As shown in FIG. 7, the identification information detection function 106 detects the image data of the corner cell 64 based on the detected position of the image data of the reference cell 62, and an area formed by the reference cell 62 and the corner cell 64. The image data of 112 is affine transformed to make the identification image 561 of the card 541 equivalent to the image 114 seen from above, and the two-dimensional pattern of the code part 60, that is, the corner cell 64 and the identification cell are obtained from the image data. A code 116 composed of 66 two-dimensional patterns is extracted, and an identification number or the like is detected from the code 116. As described above, the identification number is detected by collating the extracted code 116 with the 2D code database 68. If the identification number is not a character but relates to a field that determines the background image, the field display program 88 described later is started. If the identification number does not exist as a result of the collation, a floating image display program 100 described later is activated.

  As shown in FIG. 8, the camera coordinate detection function 108 is a camera coordinate system (6 axis directions: x, y, z, and so on) based on the detected screen coordinates and the focal length of the CCD camera 42 as the origin. θx, θy, and θz) are obtained, and the camera coordinates of the identification image 561 in the card 541 are obtained. At this time, the camera coordinates of the center of the logo portion 58 and the camera coordinates of the center of the code portion 60 in the card 541 are obtained. The obtained camera coordinates of the center of the logo portion 58 and the camera coordinates of the center of the code portion 60 are registered in the current position information table 117 shown in FIG. The current position information table 117 stores the camera coordinates of the center of the logo portion 58 of the card, the camera coordinates of the center of the code portion 60, and the camera coordinates of the character image described later in association with the identification number of the card. It is an information table for. Registration in the current position information table 117 is performed by the card position prediction program 90 in addition to the card recognition program 82. This will be described later.

  Note that the method of obtaining the camera coordinates of the image from the screen coordinates of the image drawn in the image memory 20 and the method of obtaining the screen coordinates on the image memory 20 from the camera coordinates of a certain image are described in Patent Document 2 described above. Since it is described in detail in Japanese Patent Laid-Open No. 2000-322602, please refer to Patent Document 2.

  The character image search function 110 searches the object information table 118 for a character image (eg, a character image 701 shown in FIG. 3B) based on the detected identification number.

  The breakdown of the object information table 118 includes, for example, a large number of records arranged as shown in FIG. 10, and each record includes an identification number, a character image data storage start address, and various parameters (physical strength, attack strength). , Level, etc.), valid / invalid bits are registered.

  The valid / invalid bit is a bit for determining whether or not the record is valid. The case where “invalid” is set is, for example, the case where the image of the character is not set at the current stage, or the case where the character is defeated and died in the battle set in the video game, for example.

  Then, the character image search function 110 searches the object information table 118 for a record corresponding to the identification number, and if the searched record is “valid”, the image data 120 from the storage head address registered in the record. Is read. For example, the image data 120 corresponding to the character is read from the storage head address in the data file 122 recorded on the hard disk 44, the optical disk 32, etc. and registered with a large number of image data 120. In the case of “invalid”, the image data 120 is not read.

  Accordingly, when one card 541 is placed on the desk, table 52 or the like, the card recognition program 82 is activated, and a character image 701 corresponding to the identification number specified by the identification image 561 of the placed card 541 is displayed. Will be identified. In addition, the character image search function 110, when the character image 701 is specified, the code portion of the card 541 as the camera coordinates of the character image in the record corresponding to the identification number of the card 541 in the current position information table 117. The camera coordinates at the center of 60 are registered.

  With this card recognition program 82, it is possible to express visual effects that fuse real space and virtual space. Then, control is transferred from the card recognition program 82 to various application programs (character appearance display program 84, character action display program 86, field display program 88, card position prediction program 90, etc.).

  Next, the character appearance display program 84 superimposes the character image 701 corresponding to the identification number specified in the identification image 561 of the detected card (for example, the card 541) on the identification image 561 of the card 541 to appear. As shown in FIG. 11, it has an action data string search function 124, an appearance posture setting function 126, a 3D image setting function 128, an image drawing function 130, an image display function 132, and a repetition function 134.

  The action data string search function 124 searches for the action data string for displaying the scene in which the character appears from the appearance action information table 136 based on the identification number or the like. Specifically, first, for example, a record corresponding to an identification number or the like is searched from the appearance action information table 136 recorded on the hard disk 44, the optical disk 32, etc., and the storage head address of the action data string is registered in each record. . Then, for example, the image 701 of the character appears from the storage head address registered in the searched record in the data file 140 recorded on the hard disk 44, the optical disk 32, etc. and registered with a large number of motion data strings 138. The operation data string 138 indicating the operation to be performed is read.

  The appearance posture setting function 126 sets one posture in the process in which the character image 701 appears. For example, based on the motion data of the i-th frame (i = 1, 2, 3,...) Of the read motion data sequence 138, the vertex data of the character image 701 is moved in the camera coordinate system to change one posture. Set.

  Based on the detected camera coordinates of the identification image 561 of the card 541, the three-dimensional image setting function 128 generates a three-dimensional image of one posture in the process of the appearance of the character image 701 on the identification image 561 of the card 541. Set.

  The image drawing function 130 perspectively converts a three-dimensional image of one posture in the process of appearance of the character image 701 into an image in the screen coordinate system and draws it in the image memory 20 (including hidden surface processing). At this time, in Z buffering, a scene in which the character image 701 gradually appears from below the identification image 561 of the card 541 is expressed by resetting the Z value of the character image 701 in units of frames. be able to.

  The image display function 132 outputs an image drawn in the image memory 20 to the monitor 30 via the input / output port 22 in units of one frame, and displays the image on the screen of the monitor 30.

  The repeat function 134 sequentially repeats the processing by the appearance posture setting function 126 → the processing by the three-dimensional image setting function 128 → the processing by the image drawing function 130 → the processing by the image display function 132. As a result, a scene in which the character image 701 corresponding to the identification number of the card 541 appears on the identification image 561 of the card 541 is displayed.

  Next, the character action display program 86 displays a scene where the character is waiting, an attacking scene, a magical scene, a scene scolding other characters, and the like, as shown in FIG. In almost the same manner as the character appearance display program 84, the motion data string search function 142, the posture setting function 144, the 3D image setting function 146, the image drawing function 148, the image display function 150, and the repeat function 152 are provided.

  The motion data string search function 142 searches a motion data string for displaying a scene where a character waits, an attacking scene, a magical scene, and a scene scolding another character from various motion information tables 154 corresponding to the scene. . Specifically, first, an operation information table corresponding to an operation to be displayed from various operation information tables 154 recorded on, for example, the hard disk 44, the optical disk 32, etc., and the storage head address of the operation data string is registered in each record. 154 is specified, and a record corresponding to the identification number or the like is searched from the specified operation information table 154. For example, among the data file 158 recorded on the hard disk 44, the optical disk 32, etc., and registered with a large number of motion data strings 156, the motion (character is to be displayed) from the head address registered in the retrieved record. A motion data string 156 corresponding to a standby motion, an attacking motion, a magical motion, a motion of scolding other characters, and the like.

  For example, if the character is related to the card 541, the posture setting function 144 sings one posture in the process of waiting for the character image 701, one posture in the attacking process, one posture in the process of applying magic, and scolding another character. Set one posture for the process. For example, based on the motion data of the i-th frame (i = 1, 2, 3,...) Of the read motion data sequence 156, the vertex data of the character image 701 is moved in the camera coordinate system to change one posture. Set.

  The three-dimensional image setting function 146 is one of the processes in which the character image 701 stands by on the identification image 561 of the card 541 based on the detected camera coordinates of the identification image 561 of the card 541, the process of attacking A three-dimensional image of one posture, one posture in the process of applying magic, and one posture in the process of scolding another character is set.

  The image drawing function 148 is a three-dimensional image of one posture in the process of waiting for the character image 701, one posture in the attacking process, one posture in the process of applying magic, and one posture in the process of scolding another character. Is perspective-transformed into an image in the screen coordinate system and rendered in the image memory 20 (including hidden surface processing).

  The image display function 150 outputs an image drawn in the image memory 20 to the monitor 30 via the input / output port 22 in units of one frame, and displays the image on the screen of the monitor 30.

  The repeat function 152 sequentially repeats processing by the posture setting function 144 → processing by the three-dimensional image setting function 146 → processing by the image drawing function 148 → processing by the image display function 150. As a result, a scene where the character image 701 waits, an attacking scene, a magical scene, and a scene scolding another character are displayed.

  By using the card recognition program 82, the character appearance display program 84, and the character action display program 86, a card game character can appear in a video game scenario and various actions can be performed. That is, the card game that can only be enjoyed in the real space can be expanded to the virtual space, and a new game in which the card game and the video game are fused can be provided.

  Next, the field display program 88 will be described. As shown in FIG. 13A, this program 88 is activated by the card recognition program 82 when the first card placed on the desk or table 52 or the like is a field card (hereinafter referred to as a field card 54F). Thus, as shown in FIG. 13B, a plurality of cells showing the positions where the background image 160 corresponding to the identification number specified by the identification image 56F of the field card 54F and the card for battle are to be placed on the screen of the monitor 30. The images 601 to 606 are displayed.

  As shown in FIG. 14, the field display program 88 includes a background image search function 164, a three-dimensional image setting function 166, a background image drawing function 168, a card arrangement position prediction function 170, a grid area setting function 172, and a background image display function. 174, a repetition function 176, a reference cell detection function 178, an identification information detection function 180, and a character image search function 182.

  The background image search function 162 searches the background image information table 184 for the background image 160 corresponding to the identification number of the field card 54F. In the background image information table 184, for example, as shown in FIG. 15, a large number of records are arranged, and one record includes an identification number, a storage start address of background image data, and a storage start address of an animation data string. Is registered.

  The background image search function 164 searches for a record corresponding to the identification number from the background image information table 184 recorded on, for example, the hard disk 44 or the optical disk 32. For example, among the data files 188 recorded on the hard disk 44, the optical disk 32, etc. and registered with a large number of background image data 186, the identification number of the field card 54F is determined from the storage head address registered in the searched record. The background image data 186 corresponding to is read. Further, the animation data string 190 corresponding to the identification number of the field card 54F is read from the storage head address registered in the searched record out of the data file 192 in which many animation data strings 190 are registered.

  The three-dimensional image setting function 166 sets one scene (process) of a moving background image. For example, based on the animation data of the i-th frame (i = 1, 2, 3...) Of the read animation data string 190, the vertex data of the background image data 186 is moved on the camera coordinates to display one scene. Set.

  The background image drawing function 168 perspective-transforms a three-dimensional image of one scene of a moving background image into an image in the screen coordinate system and draws it in the image memory 20 (including hidden surface processing). At this time, in Z buffering, the Z value of the background image 160 is set to a value lower than the Z value of the captured image (a value closer to the camera viewpoint than the captured image), and the background image 160 has priority over the captured image. To display.

  The card arrangement position prediction function 170 predicts the camera coordinates of a plurality of cells (six cells 601 to 606 in FIG. 13B) based on the detected camera coordinates of the field card 54F. At this time, the cell information table 194 is used. In this cell information table 194, as shown in FIG. 16, the relative coordinates when the position where the field card 54F is placed as the reference position are registered. Specifically, for example, as shown in FIG. 17, when the position where the field card 54F is placed is the origin (0, 0) on the xz plane, the relative coordinates of the first to sixth cells are (dx , -Dz), (dx, 0), (dx, dz), (-dx, dz), (-dx, 0), (-dx, -dz). The lengths of dx and dz are determined based on the actual card size, and are set to values that do not overlap adjacent cards.

  Therefore, if the camera coordinates of the reference position (origin) are determined, the camera coordinates of the six cells 601 to 606 can be easily obtained from the cell information table. The camera coordinates of these six cells 601 to 606 indicate the camera coordinates of positions where a plurality of cards other than the field card 54F (hereinafter referred to as battle cards 541 to 546) are placed.

  The cell area setting function 172 sets six cells 601 to 606 in which the battle cards 541 to 546 are to be placed at the obtained six camera coordinates, respectively. Specifically, among the Z values of the captured image, for example, a Z value corresponding to a region obtained by perspective-transforming rectangular cells 601 to 606 that are one size larger than the size of the battle cards 541 to 546 into the screen coordinate system is used as the background image. The value is set to a value lower than the Z value of 160 (a value closer to the camera viewpoint than the background image 160) so that the captured image is displayed in the portion corresponding to the six cells 601 to 606 in the background image 160. To do.

  The background image display function 174 outputs the image drawn in the image memory 20 to the monitor 30 via the input / output port 22 in units of one frame, displays the background image 160 on the screen of the monitor 30, and displays the background image 160. Among these, the captured images are displayed in the portions corresponding to the six cells 601 to 606.

  The repeat function 176 sequentially repeats processing by the three-dimensional image setting function 166 → processing by the background image drawing function 168 → processing by the card arrangement position prediction function 170 → processing by the cell area setting function 172 → processing by the background image display function 174. As a result, as shown in FIG. 12B, a background image 160 with movement is displayed on the screen of the monitor 30, and captured images are displayed on portions of the background image 160 corresponding to the six cells 601 to 606. Is displayed. That is, when the user places the battle cards 541 to 546 in portions corresponding to the six cells 601 to 606 in the desk, the table 52, or the like, the identification images 561 to 566 of the battle cards 541 to 546 are selected from the background image 160. Is clearly displayed, the user can place the battle cards 541 to 546 in accordance with the six cells 601 to 606.

  On the other hand, the reference cell detection function 178 obtains six drawing ranges on the image memory 20 from the camera coordinates of the six cells 601 to 606 while the moving background image 160 is displayed, and sets each drawing range. It is detected whether or not the identification images 561 to 566 of the battle cards 541 to 546, particularly the reference cell 62 of the logo portion 58 exists. For example, as shown in FIG. 18A, when six battle cards 541 to 546 are placed on a desk or table 52 in accordance with the six cells 601 to 606 (see FIG. 13B) displayed on the monitor 30, there are six battles. The position of each reference cell 62 of the cards 541 to 546 is detected.

  The identification information detection function 180 performs the same processing as the identification information detection function 106 in the card recognition program described above, and six cards specified from the identification images 561 to 566 of the six cards 541 to 546 placed, for example. Each identification number is detected. If the identification number does not exist as a result of the collation, a floating image display program 100 described later is activated.

  The character image search function 182 searches the object information table 118 for the character image data 120 corresponding to the identification numbers of the battle cards 541 to 546 placed corresponding to the six cells 601 to 606. For example, the record corresponding to the identification number is searched from the object information table 118, and if the searched record is “valid”, the image data 120 is read from the storage head address registered in these records. At this time, the character images 701 to 706 of the battle cards 541 to 546 placed corresponding to the six cells 601 to 606 are determined.

  Thereafter, for example, when the character appearance display program 84 is activated, as shown in FIG. 18B, characters corresponding to the identification numbers of the battle cards 541 to 546 are displayed on the identification images 561 to 566 of the battle cards 541 to 546, respectively. A scene in which the images 701 to 706 appear is displayed.

  In this field display program 88, it is not detected over the entire image memory 20 whether the user has placed the battle cards 541 to 546, but the positions where the battle cards 541 to 546 are to be placed are determined by the six cells 601 to 601. Since it is possible to recognize the battle cards 541 to 546 by detecting the positions of the six cells 601 to 606 as the center, it is not necessary to detect the entire image memory 20 every time the battle card is recognized. It is possible to reduce the load of recognition processing on the two cards 541 to 546. This leads to an increase in processing speed.

  Next, the card position prediction program 90 will be described. This program 90 is suitable for, for example, a 6-player battle, a 2-player battle, and the like, detects the position of a reference image (reference image), and predicts the position at which a battle card is placed based on the position of the reference image To do.

  As the reference image, for example, as shown in FIG. 19A, the identification image 56F of the field card 54F arranged on the desk, the table 52, etc. prior to the arrangement of the battle cards 541 to 546, or, for example, as shown in FIG. A face-to-face rectangular mat 196 for fighting is laid on a desk or table 52, etc., and six squares drawn on the mat 196 (three squares per person are arranged in the horizontal direction: first to sixth squares) 801 to 806), for example, a “+” image 198 drawn at the center position of the mat 196, for example, as shown in FIG. , A circular mat 200 for battle is laid on a desk, a table 52, etc., and a battle car is placed on each of the six squares (arranged in a circle: first to sixth squares 901 to 906) drawn on the mat 200. In the case of placing a 541 to 546, an image 202 depicted in for example, the center position of the mat 200. In addition, when an item is placed in, for example, the center or corner portion of the battle area without placing the mats 196 and 200 described above, the image of the item or the like becomes the reference image. In the following description, these images that are candidates for the reference image are referred to as “reference image 201”. As the reference image 201, it is preferable to use an image whose direction is clearly known.

  As shown in FIG. 22, the card position prediction program 90 includes a reference image detection function 204, a camera coordinate detection function 206, a detection area setting function 208, a reference cell detection function 210, and an identification information detection function 212. And a character image search function 214.

  Here, the processing operation of the card position prediction program 90 will be described with reference to FIGS. 22 to 25B.

  First, in step S <b> 1 of FIG. 23, the reference image detection function 204 detects the position of the reference image 201 from the captured image data drawn in the image memory 20. In this position detection, a plurality of images obtained by imaging a predetermined reference image 201 from various angles are registered as reference images, and easily obtained from captured image data by a method such as pattern matching using these reference images. The reference image 201 can be detected. Of course, the reference image 201 may be detected by other pattern recognition. The position of the reference image 201 is detected as screen coordinates.

  After that, in step S2, the camera coordinate detection function 206 performs a camera coordinate system (six axis directions: x, y, x, y) based on the detected screen coordinates of the reference image 201 and the focal length of the CCD camera 42. z, θx, θy, and θz) are obtained, and the camera coordinates of the detected reference image 201 are obtained. At this time, the camera coordinates of the center of the reference image 201 are obtained. The camera coordinates of the reference image 201 are registered in the register 216. The camera coordinates of the reference image 201 registered in the register 216 are used not only in the card position prediction program 90 but also in the first character movement display program 94. This will be described later.

  Thereafter, in step S <b> 3, the detection area setting function 208 obtains the camera coordinates of the area including the reference image 201 and to be detected by the reference cell detection function 210 based on the camera coordinates of the reference image 201. For example, as shown in FIG. 25A, the area to be detected is a rectangular area 218 centered on the reference image 201 if a plurality of cards are arranged in a horizontal direction in a two-player battle. As shown in FIG. 25A, if a plurality of cards are arranged in a circle in a match of three or more people, the area is a circular area 220 centered on the reference image 201. Hereinafter, the rectangular area 218 and the circular area 220 are referred to as a detection area 222.

  Thereafter, in step S4 of FIG. 23, the reference cell detection function 210 obtains the drawing range 224 of the detection area 222 on the image memory 20 from the obtained camera coordinates of the detection area 222 (see FIGS. 24B and 25B). . Thereafter, in step S5, it is detected whether or not the identification images 561 to 566 of the battle cards 541 to 546, in particular, the reference cell 62 of the logo portion 58 exists in the drawing range 224 of the detection area 222. For example, as shown in FIG. 19B, when six battle cards 541 to 546 are placed around the field card 54F, or in the first to sixth cells 801 to 806 of the mat 196 as shown in FIG. 20A. When six battle cards 541 to 546 are placed in total, or as shown in FIG. 21A, six battle cards 541 to 546 are placed according to the first to sixth cells 901 to 906 of the mat 200. In some cases, the positions of the reference cells 62 of the six battle cards 541 to 546 are detected.

  If the identification images 561 to 566 of the battle cards 541 to 546 exist, the process proceeds to step S 6, and the identification information detection function 212 performs affine transformation on the image data of the drawing range 224 and the image data of the drawing range 224. Is the image data equivalent to the image seen from above, and the two-dimensional pattern (code 116) of the identification image 561 to 566 of the six cards 541 to 546, in particular, the code portion 60 of each identification image 561 to 566 from the image data. The identification numbers of the six cards 541 to 546 are detected. As described above, the identification number is detected by collating the code 116 with the 2D code database 68.

  Thereafter, in step S7, the identification information detection function 212 obtains the camera coordinates of the identification images 561 to 566 in the six cards 541 to 546, and the camera coordinates and the respective codes of the center of each logo part 58 in the six cards 541 to 546. The camera coordinates of the center of the unit 60 are registered in the current position information table 117 shown in FIG. When the identification number cannot be detected, a floating image display program 100 described later is started.

  Thereafter, in step S 8, the character image search function 214 searches the object information table 118 for the image data 120 of the character images 701 to 706 based on the identification numbers of the battle cards 541 to 546. For example, the record corresponding to the identification number is searched from the object information table 118. If the searched record is “valid”, the image data 120 of each character is read from the storage start address of the image data registered in each record.

  After that, in step S9, the character image search function 214 identifies the character image 701 in each record corresponding to the identification number of the cards 541 to 546 in the current position information table 117 when the character images 701 to 706 are specified. The camera coordinates of the center of each code part 60 of the cards 541 to 546 are registered as camera coordinates.

  On the other hand, if it is determined in step S5 that the identification images 561 to 566 of the battle cards 541 to 546 do not exist, the reference cell detection function 210 proceeds to step S10, and all the cards are displayed on the screen of the monitor 30. An error message prompting to place 541 to 546 is output. Thereafter, in step S11, after waiting for a predetermined time (for example, 3 seconds), the process returns to step S5 and the process is repeated.

  Then, when the character images 701 to 706 have been determined for all the cards 541 to 546 existing in the detection area 222, the processing operation described above ends.

  Also in this case, for example, when the character appearance display program 84 is activated, as shown in FIGS. 18C, 19B, and 20B, the identification numbers of the cards 541 to 546 are displayed on the identification images 561 to 566 of the battle cards 541, respectively. A scene in which character images 701 to 706 corresponding to the characters appear is displayed.

  In this card position prediction program 90, the six cards 541 to 546 are recognized with respect to the detection area 222 set based on the reference image 201, so that the six cards 541 to 546 are recognized. Again, it is not necessary to detect the entire image memory 20, and the recognition processing load on the six cards 541 to 546 can be reduced.

  Next, the combination operation display program 92 will be described. In this program 92, as shown in FIG. 3A, one user 74A arranges three cards 541 to 543 in a horizontal direction on a desk, table 52, etc., and the other user 74B also places 3 cards on the desk, table 52, etc. It is assumed that two cards 544 to 546 are arranged side by side in the horizontal direction. This program 92 specifies one processing procedure from the combination of the arrangement directions of three detected cards (for example, cards 541 to 543). For example, among the three cards 541 to 543, a character that performs an action is specified according to the arrangement direction of the left card 541, an opponent character that should be influenced by the action is specified according to the arrangement direction of the center card 542, and The operation is specified by the card orientation.

  The combination display program includes a card direction detection function 226, an operation target specifying function 228, a partner specifying function 230, and an operation specifying function 232 as shown in FIG.

  Here, processing of each function after the camera coordinates of the identification images 561 to 566 of all the cards 541 to 546 are detected will be described with reference to FIGS. 3A, 3B, 26, and 27 to 29. FIG.

  First, the card direction detection function 226 is information registered in the current position information table 117, that is, camera coordinates of the identification images 561 to 566 of all the placed cards 541 to 546 (camera coordinates and codes of the logo portion 58). The identification images 561 to 566 of the cards 541 to 546 located on the left side, center, and right side of the users 74A and 74B, respectively, from which direction the user 74A and 74B see the corresponding direction. Detect whether or not If the attack or defense is turn-based, the direction of the card may be detected only for the card (card 541 to 543 or card 544 to 546) of the user 74A or 74B on the attacking side.

  In the following description, processing by the three cards 541 to 543 of the user 74A will be described in order to simplify the description.

  Then, as shown in FIG. 26, the card direction detection function 226 passes information on the direction of the identification image 561 of the card 541 placed on the left side by the user 74A to the operation target specifying function 228, and the card 542 placed in the center. The direction information of the identification image 562 of the card 543 is passed to the partner identification function 230, and the direction information of the identification image 563 of the card 543 placed on the right side is passed to the action identification function 232.

  The action target specifying function 228 is a card supplied from the card direction detection function 226 among the three character images 701 to 703 displayed superimposed on the identification images 561 to 563 of the three cards 541 to 543. One character or all characters are selected based on the information of the direction of 541.

  Specifically, for example, as shown in FIG. 27, if the direction of the left card 541 is left, the character image 701 of the left card 541 (the identification number actually specified by the identification image 561) is selected. If the direction of the card 541 is upward, the character image 702 of the central card 542 (actually the identification number specified by the identification image 562) is selected. If the direction of the card 541 is right, the right side If the image 703 of the character of the card 543 (identification number actually specified by the identification image 563) is selected and the card 541 is in the downward direction, the characters of the three cards 541 to 543 on the left, center and right Images 701 to 703 (in fact, identification numbers specified by the identification images 561 to 563) are selected. The selected identification number is registered in the first register 234.

  The opponent identifying function 230 is configured to display the card direction among the three character images 704 to 706 displayed superimposed on the identification images 564 to 566 of the three cards 544 to 546 for the opponent opponent (user 74B). Based on the direction of the card 542 supplied from the detection function 226, one character or all characters to be an opponent are selected.

  Specifically, for example, as shown in FIG. 28, if the direction of the center card 542 is left, the character image 704 of the left card 54d as viewed from the user 74B (actually identified by the identification image 564). If the identification number) is selected and the card 542 is in the upward direction, the character image 705 of the central card 545 as viewed from the user 74B (actually the identification number specified by the identification image 565) is selected, and the card If the direction of 542 is right, the character image 706 of the right card 546 as viewed from the user 74B is selected (actually the identification number specified by the identification image 566), and if the direction of the card 542 is downward. The identification number selected by the operation target specifying function 228 is selected. The selected identification number is registered in the second register 236.

  The action specifying function 232 is supplied with the action of the character corresponding to the identification number (identification number registered in the first register 234) selected by the action target specifying function 228 from the card direction detecting function 226. The selection is made based on the direction of the card 543. For example, as shown in FIG. 29, if the direction of the card 543 is left, “attack” is selected, and if the direction of the card 543 is up, “apply magic” is selected, and the direction of the card 543 is If it is right, “defend” is selected, and if the direction of the card 543 is down, “climb” is selected.

  The action specifying function 232 activates the character action display program 86 and displays a scene corresponding to the selected action when the action is selected.

  According to the combination operation display program 92, various processes can be instructed by combinations of the orientations of the three cards 541 to 543 without using an operation device (device for inputting commands by key operation). it can.

  Next, the first character movement display program 94 will be described. As shown in FIG. 30, the program 94 displays a character image 705 displayed superimposed on the identification image 565 of the card 545, for example, so as to move to the target position 240 on the captured image. The target position 240 is the position of the reference image 201, the position determined by the orientation of the plurality of cards 541 to 546, or the position of the image of the opponent character selected by the combination action display program 92 described above.

  Then, as shown in FIG. 31, the first character movement display program 94 includes a first target position setting function 242, a second target position setting function 244, a third target position setting function 246, an action data string. A search function 248, a moving posture setting function 250, a three-dimensional image setting function 252, an image drawing function 254, an image display function 256, a table rewriting function 258, a distance calculation function 260, and a repetition function 262 are provided. Note that the processing by the first to third target position setting functions 242, 244, and 246 is selectively performed according to the progress of the video game scenario.

  The first target position setting function 242 sets the position of the reference image 201 as the target position. Specifically, the camera coordinates of the reference image 201 registered in the register 216 (see FIG. 22) in the card position prediction program 90 are read out, and the camera coordinates are set as the camera coordinates of the target position.

  The second target position setting function 244 sets a position determined based on the directions of all the cards 541 to 546 placed on the desk, the table 52 or the like as the target position. For example, as shown in FIG. 32, when six cards 541 to 546 are arranged in a circle, for example, an inner center position of a polygon 264 formed by a plurality of points intersecting the center lines m1 to m6 of the cards 541 to 546 Or the center of gravity position 266 is set as a target position. This can be applied when more than two cards are placed in a circle. Specifically, the information registered in the current position information table 117, that is, the camera coordinates of the identification images 561 to 566 of all the placed cards 541 to 546 (the camera coordinates and code part 60 of the logo part 58). The camera coordinates of the center lines m1 to m6 of all the cards 541 to 546 are obtained from the camera coordinates), the camera coordinates of a plurality of points where the obtained center lines m1 to m6 intersect are extracted, and the extracted points are The camera coordinates of the center position or the center of gravity position 266 of the polygon 264 configured as described above are set as the camera coordinates of the target position.

  The third target position setting function 246 sets the position of the image of the opponent character selected by the combination action display program 92 as the target position. Specifically, the identification number registered in the second register 236 (see FIG. 26) in the combination operation display program 92 is read, and the read identification number among the information registered in the current position information table 117 is read out. The camera coordinates corresponding to (for example, the camera coordinates of the character image) are set as the camera coordinates of the target position.

  For example, as shown in FIG. 30, the motion data string search function 248 first moves the motion data string for displaying a scene in which the character image 705 moves from the identification image 565 of the card 545 to the target position 240. The operation information table 268 is searched. Specifically, first, for example, a record corresponding to the identification number of the card 545 is searched from the first movement operation information table 268 recorded on the hard disk 44, the optical disk 32, or the like. Then, for example, among the data file 272 recorded on the hard disk 44, the optical disk 32, etc. and registered with a large number of motion data strings 270, the image 705 of the character from the storage head address registered in the searched record is the target position 240. The operation data string 270 indicating the operation to move to is read.

  The movement posture setting function 250 reads the camera coordinates of the character image 705 from the record corresponding to the identification number in the current position information table 117, and the character image 705 moves to the target position 240 at the camera coordinates. One posture of the process is set. For example, based on the motion data of the i-th frame (i = 1, 2, 3...) Of the read motion data sequence 270, the vertex data of the character image 705 is moved on the camera coordinates to change one posture. Set.

  The three-dimensional image setting function 252 is one of processes in which the character image 705 moves from the identification image 565 of the card 545 to the target position 240 based on the camera coordinate system of the captured image detected by the card recognition program 82 or the like. Set a 3D image of the posture.

  The image drawing function 254 perspective-converts a three-dimensional image of one posture in the process of moving the character image 705 to the target position 240 into an image in the screen coordinate system and draws it in the image memory 20 (including hidden surface processing). .

  The image display function 256 outputs the image drawn in the image memory 20 to the monitor 30 via the input / output port 22 in units of one frame, and displays the image on the screen of the monitor 30.

  The table rewriting function 258 indicates the camera coordinates of the character image 705 after the character image 705 is moved during one frame, and the character image 705 of the record corresponding to the identification number in the current position information table 117. Rewrite as camera coordinates.

  The distance calculation function 260 determines the distance between the position of the character image 705 and the target position 240 from the camera coordinates of the character image 705 and the camera coordinates of the target position 240 after the character image 705 is moved during one frame. The shortest distance (straight line distance) is calculated.

  The repeat function 262 performs processing by the moving posture setting function 250 → processing by the three-dimensional image setting function 252 until the distance calculated by the distance calculation function 260 falls within a predetermined range (for example, 0 mm to 10 mm when converted in real space). -> Processing by image drawing function 254-> Processing by image display function 256-> Processing by table rewriting function 258-> Processing by distance calculation function 260 is sequentially repeated. Thus, as shown in FIG. 30, a scene in which the character image 705 corresponding to the identification number of the card 545 moves from the identification image 565 of the card 545 to the target position 240 is displayed.

  According to the first character movement display program 94, when applied to a video game, for example, as shown in FIG. 30, for example, the character image 705 appearing from the card 545 moves to the target position and battles, etc. This is suitable for a battle game or the like. For example, in the case of a six-player match shown in FIG. 33, images 701 to 706 of six characters move from the identification images 561 to 566 of the corresponding cards 541 to 546 toward the center of the circle, respectively. You can display the scene of fighting. For example, in the case of a two-person battle shown in FIG. 34, for example, the target positions (for example, the center position) of the battle area from the identification images 563 and 565 of the cards 543 and 545 corresponding to the images 703 and 705 of the two characters, respectively. As shown in FIG. 35, the attacking character image 705 moves from the corresponding identification image 565 of the card 545 to the position of the attacking character image 703, as shown in FIG. You can display a scene of fighting.

  Next, the second character movement display program 96 will be described. For example, as shown in FIG. 36, the program 96 uses, for example, the character image 705 moved from the identification image 565 of the card 545 to the target position 240 as shown in FIG. The display of moving on the identification image 564 is performed. Information on which position the character image 705 has moved is registered in the current position information table 117 described above.

  As shown in FIG. 37, the second character movement display program 96 includes an operation data string search function 274, a movement posture setting function 276, a three-dimensional image setting function 278, an image drawing function 280, an image display function 282, a table rewriting function. A function 284, a distance calculation function 286, and a repetition function 288 are provided.

  The motion data string search function 274 displays a scene in which, for example, the character image 705 shown in FIG. 36 moves (returns) from the current position (for example, the above-described target position 240) onto the corresponding image 705 of the card 545. An operation data string is searched from the second movement operation information table 290. Specifically, first, a record corresponding to the identification number is searched from the second movement operation information table 290 recorded on the hard disk 44 or the optical disk 32, for example. Then, for example, among the data file 294 recorded on the hard disk 44, the optical disk 32, etc. and registered with a large number of motion data strings 292, the image 705 of the character is stored in the card from the storage head address registered in the searched record. The operation data string 292 indicating the operation of moving to the identification image 565 of 545 is read out.

  The movement posture setting function 276 reads the camera coordinates of the character image 705 from the record corresponding to the identification number in the current position information table 117, and displays the character image 705 on the identification image 565 of the card 545 corresponding to the character image 705. One posture of the process of moving to is set. For example, based on the motion data of the i-th frame (i = 1, 2, 3...) Of the read motion data sequence 292, the vertex data of the character image 705 is moved on the camera coordinates to change one posture. Set.

  The 3D image setting function 278 is a process in which the character image 705 moves from the current position to the identification image 565 of the corresponding card 545 based on the camera coordinate system of the captured image detected by the card recognition program 82 or the like. Set a three-dimensional image of one posture.

  The image drawing function 280 perspectively converts a three-dimensional image of one posture in the process of moving the character image 705 to the identification image 565 of the corresponding card 545 into an image in the screen coordinate system, and draws (hides) the image in the image memory 20. Surface treatment).

  The image display function 282 outputs an image drawn in the image memory 20 to the monitor 30 via the input / output port 22 in units of one frame, and displays the image on the screen of the monitor 30.

  The table rewriting function 284 indicates the camera coordinates of the character image 705 after the character image 705 is moved during one frame, and the character image 705 of the record corresponding to the identification number in the current position information table 117. Rewrite as camera coordinates.

  The distance calculation function 286 is a distance between the camera coordinates of the identification image 565 of the card 545 corresponding to the identification number and the current position (camera coordinates) of the character corresponding to the identification number stored in the current position information table 117. Is calculated.

  The repeat function 288 performs processing by the moving posture setting function 276 → processing by the three-dimensional image setting function 278 → processing by the image drawing function 280 → processing by the image display function 282 until the distance calculated by the distance calculating function 286 becomes 0 → The processing by the table rewriting function 284 → the processing by the distance calculation function 286 is sequentially repeated. As a result, for example, as shown in FIG. 36, a scene in which the character image 705 moves on the identification image 565 of the corresponding card 545 is displayed.

  According to the second character movement display program 96, for example, when applied to a video game, the image 705 of the character appearing from the card 545 moves to the target position 240 and battles, and when the battle is won. It is possible to display such as returning to the original card 545, which is suitable for a battle game or the like. For example, in the case of a six-player battle shown in FIG. 33, images 701, 702 and 704 of characters winning the battle are shown in FIG. Can be displayed on the identification images 561, 562, and 564 of the corresponding cards 541, 542, and 544, respectively. For example, in the case of a two-player battle shown in FIG. 34, as shown in FIG. 39, only the image 703 of the character that won the battle out of the images 703 and 705 of the two characters headed for the attack is the original card. A scene of returning to the identification image 563 of 543 can be displayed.

  Next, the character invalidation program 98 will be described. When the character loses in battle, the program 98 displays a scene that gradually disappears while performing a certain action, and further invalidates the appearance of the character thereafter.

  As shown in FIG. 40, the character invalidation program 98 includes a motion data string search function 296, a disappearance posture setting function 298, a three-dimensional image setting function 300, an image drawing function 302, an image display function 304, a repeat function 306, an invalidity. A bit setting function 308 is provided.

  The motion data string search function 296 searches the disappearance display information table 310 for a motion data string for displaying a scene that gradually disappears while performing a certain motion of the character image. Specifically, first, a record corresponding to the identification number is searched from the disappearance display information table 310 recorded on the hard disk 44, the optical disk 32, or the like. Then, for example, among the data file 314 recorded on the hard disk 44, the optical disk 32, etc., and registered with a large number of motion data strings 312, the image of the character gradually starts from the storage head address registered in the searched record. The operation data string 312 indicating the operation that disappears is read.

  The disappearance posture setting function 298 sets one posture in the process of disappearing the character image. For example, based on the motion data of the i-th frame (i = 1, 2, 3,...) Of the read motion data sequence 312, the vertex data of the image of the character is moved on the camera coordinates to change one posture. Set.

  The three-dimensional image setting function 300 has one posture in the process in which the character image disappears on the card identification image, the target position 240, or the like based on the camera coordinate system of the captured image detected by the card recognition program 82, for example. Set a 3D image.

  The image drawing function 302 perspective-transforms a three-dimensional image of one posture in the process of disappearing the image of the character into an image of the screen coordinate system and draws it in the image memory 20 (including hidden surface processing).

  The image display function 304 outputs an image drawn in the image memory 20 to the monitor 30 via the input / output port 22 in units of one frame, and displays the image on the screen of the monitor 30.

  The repeat function 306 sequentially repeats processing by the disappearance posture setting function 298 → processing by the three-dimensional image setting function 300 → processing by the image drawing function 302 → processing by the image display function 304. As a result, a scene is displayed that gradually disappears while performing an operation of the image of the character on the identification image of the card corresponding to the character, the target position 240, or the like.

  The invalid bit setting function 308 sets the valid / invalid (1/0) bit of the record corresponding to the character (that is, the record corresponding to the identification number) in the object information table 118 to “invalid”.

  According to the character invalidation program 98, for example, when applied to a video game, when a character appearing from a card moves to a predetermined position and fights, and loses and dies in the battle, it gradually disappears. It is possible to display such as a game, which is suitable for a battle game or the like.

  By the way, as the video game progresses, a card placed on a desk or table 52 may be moved by the user's hand. For example, the position of one or more cards may be shifted, the arrangement of cards may be changed, or a new card may be exchanged. Thus, when a card | curd has moved, it is necessary to recognize again about the card | curd which moved.

  In order to solve this, the card recognition program 82 and the card position prediction program 90 may be activated in units of several frames or several tens of frames. Of course, when a new card is recognized, the character appearance display program 84 is activated and a character image corresponding to the new card identification number or the like may appear on the new card identification image. Further, if the position of the card is shifted or the arrangement is changed, the character action display program 86 may be activated to display, for example, a “standby” action.

  However, re-recognition of this card may fail. For example, once the card is placed and the corresponding character appears, the card is retracted and left as it is, the surface of the card is hidden by another object (such as the user's hand), or the imaging surface of the CCD camera 42 is displaced. If the card surface cannot be captured, the card may not be re-recognized. An application program that performs processing in such a case will be described below.

  First, the floating image display program 100 will be described. When the re-recognition of the card fails, the program 100 displays an image (floating image) in which a data string composed of an arbitrary combination of “1” and “0” is described in an ellipse as shown in FIG. 41, for example. The image 316) is displayed to float for a predetermined time. FIG. 41 shows an example in which recognition of the card 546 fails (indicated by “x” for easy understanding).

  The floating image display program 100 is started from the card recognition program 82, the field display program 88, or the card position prediction program 90 when the identification information cannot be detected. As shown in FIG. Timekeeping function 318, floating image reading function 320, motion data string reading function 322, floating posture setting function 324, three-dimensional image setting function 326, image drawing function 328, image display function 330, repetition function 332, floating image erasure A function 334.

  The time measuring function 318 starts counting the clock pulses Pc when the program 100 is started, and outputs a time-up signal St when a predetermined time (for example, 1 minute, 2 minutes, 3 minutes, etc.) is timed. To reset the timing data.

  The specific image reading function 320 reads the image data (floating image data) 336 of the floating image 316 shown in FIG. 41 from, for example, the hard disk 44 or the optical disk 32.

  The operation data string reading function 322 reads an operation data string 338 for displaying a scene in which the floating image 316 is floating and moving, for example, from the hard disk 44 or the optical disk 32.

  The floating posture setting function 324 sets one posture of the process in which the floating image 316 floats and moves. For example, based on the motion data of the i-th frame (i = 1, 2, 3...) Of the read motion data sequence 338, the vertex data of the floating image data 336 is moved on the camera coordinates to change one posture. Set.

  The three-dimensional image setting function 326 sets a three-dimensional image of one posture in the process of floating and moving the floating image 316 based on, for example, the camera coordinate system of the captured image detected by the card recognition program 82 or the like.

  The image drawing function 328 perspective-converts a three-dimensional image having one posture in the process of floating the floating image 316 into a screen coordinate system image and draws the image in the image memory 20 (including hidden surface processing).

  The image display function 330 outputs an image drawn in the image memory 20 to the monitor 30 via the input / output port 22 in units of one frame, and displays the image on the screen of the monitor 30.

  The repeat function 332 performs processing by the floating posture setting function 324 → processing by the three-dimensional image setting function 326 → processing by the image drawing function 328 → processing by the image display function 330 until the time-up signal St is output from the time measuring function 318. Repeat sequentially. As a result, as shown in FIG. 41, a scene in which the floating image 316 moves while floating on the screen of the monitor 30 is displayed.

  The floating image display program 100 displays the floating image 316 so that the user can no longer recognize some cards (card 546 in the example of FIG. 41) or all the cards. Can be shown.

  Next, the landing display program 102 will be described. As shown in FIG. 43, this program 102 displays the image of the character corresponding to the identification number of the card 546 when the re-recognition of the card 546 succeeds after the floating image 316 is floated. A display for landing 706 on the identification image 566 of the card 546 is performed.

  The landing display program 102 displays the card recognition program 82, the field display program 88, or the card position prediction program 90 when the card identification information is correctly detected after the floating image 316 is displayed. 44. As shown in FIG. 44, the motion data string search function 340, the landing posture setting function 342, the three-dimensional image setting function 344, the image drawing function 346, the image display function 348, the distance calculation function 350, and the repetition A function 352 is included. From the card recognition program 82, the field display program 88, or the card position prediction program 90 described above, the identification number of the card that has been successfully recognized again and the camera coordinates of the identification image of the corresponding card are supplied.

  For example, as shown in FIG. 43, the action data string search function 340 displays an action data string for displaying a scene where the character image 706 pops out from the position of the floating image 316 and lands on the corresponding identification image 566 of the card 546. Is retrieved from the landing motion information table 354. Specifically, first, for example, a record corresponding to the identification number is searched from the landing operation information table 354 recorded on the hard disk 44, the optical disk 32, or the like. Then, for example, from the storage head address registered in the searched record among the data files 358 recorded on the hard disk 44, the optical disk 32, etc. and registered with a large number of motion data strings 356, the image 706 of the character is supported. The operation data string 356 indicating the operation of landing on the identification image 566 of the card 546 to be read is read out.

  The landing posture setting function 342 sets one posture in the process of landing the character image 706 on the identification image 566 of the corresponding card 546. For example, based on the motion data of the i-th frame (i = 1, 2, 3...) Of the read motion data sequence 356, the vertex data of the character image 706 is moved on the camera coordinates to change one posture. Set.

  For example, the three-dimensional image setting function 344, based on the camera coordinate system of the captured image detected by the card recognition program 82 or the like, lands the character image 706 on the identification image 566 of the corresponding card 546 from the position of the floating image 316. A three-dimensional image of one posture in the process is set.

  The image drawing function 346 performs perspective conversion of a three-dimensional image of one posture in the process of landing on the identification image 566 of the card 546 to which the character image 706 corresponds, and draws (hides) the image in the image memory 20. Surface treatment).

  The image display function 348 outputs the image drawn in the image memory 20 to the monitor 30 via the input / output port 22 in units of one frame, and displays the image on the screen of the monitor 30.

  The distance calculation function 350 calculates the distance between the camera coordinates of the image 706 of the character moved during one frame and the camera coordinates of the identification image 566 of the card 546 corresponding to the identification number.

  The repeat function 352 performs processing by the landing posture setting function 342 → processing by the three-dimensional image setting function 344 → processing by the image drawing function 346 → processing by the image display function 348 until the distance calculated by the distance calculating function 350 becomes 0 → The processing by the distance calculation function 350 is sequentially repeated. Accordingly, for example, as shown in FIG. 43, a scene in which the character image 706 lands on the identification image 566 of the corresponding card 546 is displayed.

  In this landing display program 102, for example, a character image 706 pops out from the floating image 316 and can be displayed on the identification image 566 of the corresponding card 546, so that the character of the card 546 is unknown. Therefore, it is possible to give the video game a virtual space and make it feel like it has landed.

  In the above-mentioned example, mainly the case of two-player battle or six-player battle was shown, but other three-player battles, four-player battles, five-player battles, and battles of more than seven players can be easily applied. be able to.

The image display system according to the present invention, images processing system, a recording medium, and program is not limited to the above embodiments without departing from the gist of the present invention, it may take various configurations, of course is there.

It is a block diagram which shows the structure of the video game system which concerns on this Embodiment. FIG. 2A is a plan view showing the front surface of the card, and FIG. 2B is a rear view showing the back surface of the card. 3A and 3B are explanatory diagrams showing an example of a usage pattern of the video game system according to the present embodiment. 4A and 4B are explanatory diagrams showing another example of usage of the video game system according to the present embodiment. It is a block diagram which shows the application program performed with the video game system which concerns on this Embodiment. It is a block diagram which shows the function of a card recognition program. It is explanatory drawing which shows the process until it detects the identification number of a card | curd from the identification image of the imaged card | curd. It is explanatory drawing which shows the process of calculating | requiring the camera coordinate of a captured image from the captured captured image. It is explanatory drawing which shows the breakdown of a present position information table. It is explanatory drawing which shows the breakdown of an object information table. It is a block diagram which shows the function of a character appearance display program. It is a block diagram which shows the function of a character action display program. FIG. 13A is an explanatory diagram showing a state in which a field card is placed on a desk, table, etc., and FIG. 13B is an example in which a background image corresponding to the field card and a grid indicating the position where the battle card should be placed are displayed on the monitor screen. It is explanatory drawing which shows. It is a block diagram which shows the function of a field display program. It is explanatory drawing which shows the breakdown of a background image information table. It is explanatory drawing which shows the breakdown of a cell information table. It is a figure for demonstrating the relative coordinate of six squares. FIG. 18A is an explanatory diagram showing a state in which a field card and a battle card are placed on a desk, a table, etc., and FIG. 18B is a background image corresponding to the field card on the monitor screen and a grid indicating the position where the battle card is to be placed. It is explanatory drawing which shows the example which displayed the image of the character specified by the identification image of a battle card. FIG. 19A is an explanatory view showing a state where a field card is placed on a desk or table, FIG. 19B is an explanatory view showing a state where a field card and a battle card are placed, and FIG. 19C is a view showing a battle card on the monitor screen. It is explanatory drawing which shows the example which displayed the image of the character specified by an identification image. FIG. 20A is an explanatory diagram showing an example in which a mat for fighting two people is laid on a desk, a table, etc., and a battle card is placed on the grid of the mat, and FIG. It is explanatory drawing which shows the example which displayed the image of the character to be. FIG. 21A is an explanatory view showing an example in which a mat for fighting six people is laid on a desk, a table, etc., and a fighting card is placed on the mat, and FIG. It is explanatory drawing which shows the example which displayed the image of the character to be. It is a block diagram which shows the function of a card position prediction program. It is a flowchart which shows the process of a card position prediction program. 24A and 24B are explanatory diagrams showing a process for obtaining a detection area when a plurality of cards are arranged in the horizontal direction in a two-player battle. FIG. 25A and FIG. 25B are explanatory diagrams illustrating a process of obtaining a detection area when a plurality of cards are arranged in a circle in a battle of three or more players. It is a block diagram which shows the function of a combination operation | movement display program. It is explanatory drawing which shows the example which specifies operation | movement object according to the arrangement | positioning direction of the left card | curd among three cards. It is explanatory drawing which shows the example which specifies an other party according to the arrangement | positioning direction of the center card | curd among three cards. It is explanatory drawing which shows the example which specifies operation | movement according to the arrangement | positioning direction of the card | curd on the right side among three cards. It is explanatory drawing which shows the example of the scene where the image of the character currently displayed on the identification image of a card | curd moves to a target position. It is a block diagram which shows the function of a 1st character movement display program. It is explanatory drawing which shows the example which determines a target position according to the arrangement | positioning direction of six cards arrange | positioned at a circle. It is explanatory drawing which shows the example of a scene where the image of six characters moves toward the center of a circle from the identification image of a card | curd corresponding, respectively, and unfolds a battle in the center of this circle. It is explanatory drawing which shows the example of the scene where the image of two characters moves to the target position (for example, center position) of a battle | competition area from the identification image of a card | curd corresponding, respectively, and performs a battle. It is explanatory drawing which shows the example of the scene which moves to the position of the character image which is an attack opponent from the identification image of the card | curd with which the image of the attacking character corresponds, and performs a battle. It is explanatory drawing which shows the example of the scene where the image of the character which moved to the target position from on the identification image of a card | curd moves on the identification image of the original card | curd. It is a block diagram which shows the function of a 2nd character movement display program. It is explanatory drawing which shows the example of the scene where the image of the character who won the battle returns to the identification image of each corresponding card | curd. It is explanatory drawing which shows the example of a scene where only the image of the character which won by battle among the images of the two characters which headed for the attack returns to the identification image of the original card | curd. It is a block diagram which shows the function of a character invalidation program. It is explanatory drawing which shows the example of the scene which floats a floating image over predetermined time. It is a block diagram which shows the function of a floating image display program. FIG. 6 is an explanatory diagram showing an example of a scene in which when a card re-recognition succeeds after the floating image is displayed, the character image corresponding to the card identification number is landed on the card identification image. is there. It is a block diagram which shows the function of a landing display program.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 ... Video game system 12 ... Video game machine 16 ... CPU 18 ... Main memory 20 ... Image memory 30 ... Monitor 32 ... Optical disk 38 ... Memory card 42 ... CCD camera 44 ... Hard disk 54, 541-546 ... Card 56, 561-566 ... Identification image 58 ... Logo part 60 ... Code part 62 ... Reference cell 64 ... Corner cell 66 ... Identification cell 82 ... Card recognition program 84 ... Character appearance display program 86 ... Character action display program 88 ... Field display program 90 ... Card position prediction Program 92 ... Combination operation display program 94 ... First character movement display program 96 ... Second character movement display program 98 ... Character invalidation program 100 ... Floating image display program 102 ... Landing display program 701 to 706 ... Character image

Claims (14)

A computer,
Imaging means connected to the computer and imaging a plurality of cards each having an identification image attached thereto;
In an image display system having a display device connected to the computer,
Captured image display control means for outputting image data of a captured image including identification images of the plurality of cards from the imaging means to the display device, and displaying the captured image on the display device;
Detecting means for detecting image data of each identification image affixed to the plurality of cards from the image data of the captured image;
Identification information detection means for detecting identification information of the card from image data of the identification image detected by the detection means;
Among the captured images, target position setting means for setting a specific target position;
Object display control means for controlling to superimpose and display an image of an object corresponding to the identification information of each card on the displayed identification images of the plurality of cards;
An image display system, comprising: an object movement display control unit configured to perform control so that a displayed image of the object moves to the specific target position. The image display system according to claim 1,
2. An image display system comprising: a second object movement display control unit configured to perform control so that an image of the object moved to the target position is moved to a position of an identification image of a corresponding card. The image display system according to claim 1,
Object erasure display control means for controlling to perform display for erasing the image of the object moved to the target position;
An image display system comprising: identification information invalidating means for invalidating identification information of a card corresponding to the erased object. The image display system according to any one of claims 1 to 3,
The target position setting means includes
Reference image detection means for detecting image data of a predetermined reference image among the captured images,
An image display system characterized in that the position of the reference image detected by the reference image detection means is set as the specific target position. The image display system according to any one of claims 1 to 3,
The target position setting means includes
Means for detecting an arrangement direction of the plurality of cards based on image data of the plurality of identification images detected by the detection means;
The image display system, wherein the specific target position is set from an arrangement direction of the plurality of cards. The image display system according to any one of claims 1 to 3,
The target position setting means includes
Means for detecting an arrangement direction of the plurality of cards based on image data of the plurality of identification images detected by the detection means;
Means for selecting one object based on the arrangement direction of the detected plurality of cards among the plurality of displayed objects;
An image display system characterized in that the position of the selected one object is set as the specific target position. A computer,
In an image processing system having an imaging unit connected to the computer and imaging a card to which an identification image is attached,
Reference image detection means for detecting image data of a predetermined reference image among the captured images from the imaging means;
Coordinate system conversion means for obtaining a camera coordinate system of the entire captured image from the position of the image data of the reference image detected by the reference image detection means;
Detection area setting means for setting a specific detection area based on camera coordinates of image data of the reference image;
Detection means for detecting image data of an identification image attached to the card from image data included in the detection area among the captured images;
An image processing system comprising: identification information detection means for detecting identification information of the card from image data of the identification image detected by the detection means. The image processing system according to claim 7.
The image processing system, wherein the specific detection area is a rectangular area centered on the reference image. The image processing system according to claim 7.
The image processing system, wherein the specific detection area is a circular area centered on the reference image. The image processing system according to any one of claims 7 to 9,
The identification information detecting means includes
An image processing system for detecting identification information of the card by performing affine transformation on image data of the identification image of the card detected by the detection means. A computer,
Imaging means connected to the computer and imaging a plurality of cards each having an identification image attached thereto;
An image display system having a display device connected to the computer,
A captured image display control unit that outputs image data of a captured image including identification images of the plurality of cards from the imaging unit to the display device, and causes the display device to display the captured image;
Detecting means for detecting image data of each identification image affixed to the plurality of cards from image data of the captured image;
Identification information detection means for detecting identification information of the card from image data of the identification image detected by the detection means;
Among the captured images, target position setting means for setting a specific target position,
Object display control means for controlling so as to superimpose and display an image of an object corresponding to the identification information of each card on the displayed identification images of the plurality of cards;
Object movement display control means for controlling the displayed image of the object to move to the specific target position;
A computer-readable recording medium on which a program for functioning as a computer is recorded. A computer,
An image processing system connected to the computer and having imaging means for imaging a card to which an identification image is attached;
Reference image detection means for detecting image data of a predetermined reference image among the captured images from the imaging means,
Coordinate system conversion means for obtaining a camera coordinate system of the entire captured image from the position of the image data of the reference image detected by the reference image detection means;
Detection area setting means for setting a specific detection area based on camera coordinates of image data of the reference image;
Detection means for detecting image data of an identification image affixed to the card from image data included in the detection area among the captured images;
Identification information detection means for detecting identification information of the card from image data of the identification image detected by the detection means;
A computer-readable recording medium on which a program for functioning as a computer is recorded. A computer,
Imaging means connected to the computer and imaging a plurality of cards each having an identification image attached thereto;
An image display system having a display device connected to the computer,
A captured image display control unit that outputs image data of a captured image including identification images of the plurality of cards from the imaging unit to the display device, and causes the display device to display the captured image;
Detecting means for detecting image data of each identification image affixed to the plurality of cards from image data of the captured image;
Identification information detection means for detecting identification information of the card from image data of the identification image detected by the detection means;
Among the captured images, target position setting means for setting a specific target position,
Object display control means for controlling so as to superimpose and display an image of an object corresponding to the identification information of each card on the displayed identification images of the plurality of cards;
Object movement display control means for controlling the displayed image of the object to move to the specific target position;
Program to function as. A computer,
An image processing system connected to the computer and having imaging means for imaging a card to which an identification image is attached;
Reference image detection means for detecting image data of a predetermined reference image among the captured images from the imaging means,
Coordinate system conversion means for obtaining a camera coordinate system of the entire captured image from the position of the image data of the reference image detected by the reference image detection means;
Detection area setting means for setting a specific detection area based on camera coordinates of image data of the reference image;
Detection means for detecting image data of an identification image affixed to the card from image data included in the detection area among the captured images;
Identification information detection means for detecting identification information of the card from image data of the identification image detected by the detection means;
Program to function as.

Images