JP2979586B2 - Image information processing method - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION [Industrial Application Field] The present invention relates to an information retrieval system for a structure composed of a group of objects arranged spatially, for example, an urban design, a building, an interior and an automobile, an airplane, and the like. The present invention relates to an image information processing method suitable for being applied to an image information storage device for components having a high degree of complexity, and in particular, when the number of stored images and the number of objects are increased, the amount of stored information is reduced. The present invention relates to an image information processing method that does not increase so much.

[Conventional technology]

In a conventional image information processing apparatus, region information corresponding to each object is stored for each still image.

 Hereinafter, this will be described more specifically.

FIG. 3 is a configuration diagram showing an example of a conventional image information processing apparatus. In the figure, reference numeral 1 denotes an image display device, 2 denotes an area information storage device, and 3 denotes a coordinate input device. When using this device, the user looks at the image displayed on the image display device 1 and selects an object using the coordinate input device 3. By inquiring the area information storage device 2 about the input coordinate information input from the coordinate input device 3 and the image identification number of the image being displayed, the selected object can be identified.

[Problems to be solved by the invention]

In the above-described prior art, since the area information storage device 2 needs to store the area information for each image and each object, if the number of images and the number of objects increase, the amount of information becomes enormous. Was a serious problem.

The present invention has been made in view of the above circumstances, and an object of the present invention is to solve the above-described problems in the conventional technology and to suppress an increase in the amount of information even when the number of images and the number of objects increase. It is an object of the present invention to provide an image information processing method capable of performing the following.

[Means for solving the problem]

The above object of the present invention is an information storage means for storing three-dimensional spatial information including viewpoint and line-of-sight direction information of a target object group,
Display means for displaying a group of object images based on the three-dimensional spatial information stored in the information storage means; and input of coordinate information of an object specified by a user from among the images displayed on the display means An image information processing method in an image information processing apparatus having coordinate input means, wherein a step of displaying an object image group on the image display means based on three-dimensional spatial information stored in the information storage means, Acquiring, from the image displayed on the means, coordinate information of the object designated by the user by the coordinate input means; viewpoint / gaze direction information of the object image group stored in the information storage means and the coordinates; Identifying the target specified by the user from the coordinate information of the target input from the input means. In addition, the object is identified by determining the first intersection point between a line connecting the viewpoint / line-of-sight direction coordinates and the input coordinates and the three-dimensional object surface by geometric calculation in three dimensions. It is characterized by doing.

[Action]

In the image information processing method according to the present invention, instead of preparing area information for each image, an association between an object group image and information accompanying the object is prepared, so that a certain viewpoint in a virtual environment can be obtained. -Searching for required image information using an image viewed from the line of sight (hereinafter referred to as "projection").

That is, the user looks at the image displayed on the image display device, and specifies the target object to be searched by the user using the coordinate input device from the projection of the target group displayed there. By doing so, the device, the above-described three-dimensional target information object information, the direction information of the viewpoint and line of sight of the image displayed on the image display means when the user indicates the target, and the user Using the coordinate information input using the coordinate input means, the first intersection point between the line connecting the viewpoint coordinates and the input coordinates by geometric calculation in three dimensions and the first intersection point with the three-dimensional object surface is selected. The object can be determined.

〔Example〕

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

FIG. 2 is a configuration diagram of an image information processing apparatus (hereinafter, also simply referred to as “apparatus”) showing one embodiment of the present invention. In the figure, symbols 1 and 3 indicate the same components as previously shown in FIG. The symbol 2A is a three-dimensional space information storage device, and a three-dimensional object information storage unit 21 and a shooting information storage unit 22 are provided in the three-dimensional space information storage device 2A.

The three-dimensional object information storage unit 21 stores three-dimensional definition information of an object corresponding to all image information stored in the three-dimensional spatial information storage device 2A in correspondence with a subject identifier. Further, the shooting information storage unit 22 stores viewpoint / sight information corresponding to each display image corresponding to each display image (frame).

Hereinafter, the operation of the present embodiment configured as described above will be described.

FIG. 1 shows the principle of a method for identifying an object from a position designated on the screen of the image display device 1 by a user based on the above-described three-dimensional definition information of the object and the direction of the viewpoint and line of sight. It is shown. FIG. 1 (a) is a perspective view and FIG. 1 (b) is a top view. In FIG. 1, reference numeral 11 denotes a viewpoint, 12 denotes a point corresponding to the input coordinates, and 13 denotes a straight line passing through the viewpoint 11 and a point 12 corresponding to the input coordinates.

The user looks at the image of the object presented on the screen of the image display device 1 and inputs the coordinates of an arbitrary point in the area occupied by the object using the coordinate input device 3. Based on the frame number of the image currently displayed on the image display device 1, the device searches the shooting information storage unit 22 to obtain a viewpoint and a line-of-sight direction, and this is input from the coordinate input device 3. From the coordinate information obtained, the above-described straight line 13 is obtained, and from this and the three-dimensional definition information of the object in the three-dimensional object information storage unit 21, the first intersection of the straight line 13 and the three-dimensional object surface is obtained. , The selected object is identified.

This identification solves a simple geometrical problem of finding an intersection between the straight line 13 and the surface 14 determined by the definition equation of the shape of the object.

In the above embodiment, the three-dimensional spatial information storage device 2A
In other words, the three-dimensional object information storage unit 21 and the photographing information storage unit 22 only need to store the object group information and the viewpoint / gaze direction. Therefore, even when the number of images and the number of objects are increased, However, the amount of increase in the amount of information is relatively small, and an image information processing apparatus capable of suppressing an increase in the amount of information as compared with the number of images and the number of objects can be realized. By applying this, for example, a device that selects an object visible in a moving image at an arbitrary point in time, with a small storage capacity,
There is also an effect that it can be easily realized.

It should be noted that the above embodiment is shown as an example of the present invention, and it is needless to say that the present invention is not limited to this.

〔The invention's effect〕

As described above in detail, according to the present invention, it has a coordinate input unit, an image display unit, and an information storage unit, and presents an object group image displayed on the image display unit to a user. In the information processing apparatus for extracting the requested object using the coordinate information input from the coordinate input means and the information corresponding to the object in the information storage means, the information stored in the information storage means is tertiary. As the original space information, the object specified by the user was identified from the coordinate information input by the user from the coordinate input means and the three-dimensional space information stored in the information storage means. Even if the number of images and the number of objects increase, there is a remarkable effect that an image information processing method capable of suppressing an increase in the amount of information can be realized.

[Brief description of the drawings]

FIG. 1 is an explanatory diagram of an image information processing method showing one embodiment of the present invention, FIG. 2 is a configuration diagram of an image information processing device of the embodiment, and FIG. 3 is a configuration showing an example of a conventional image information processing device. FIG. 1: Image display device, 2A: 3D spatial information storage device, 21: 3D object information storage unit, 22: shooting information storage unit, 3: coordinate input device, 11: viewpoint, 12: point corresponding to input coordinates , 13: a straight line passing through the viewpoint 11 and the point 12 corresponding to the input coordinates, 14: the surface of the object.

──────────────────────────────────────────────────続 き Continued on the front page (58) Field surveyed (Int.Cl. ⁶ , DB name) G06T 1/00 G06T 17/40 G06F 3/00 G06F 3/14

Claims (2)

(57) [Claims] 1. An information storage means for storing three-dimensional spatial information including viewpoint and line-of-sight direction information of an object image group, and an object image group is displayed based on the three-dimensional spatial information stored in the information storage means. An image information processing method in an image information processing apparatus, comprising: a display unit for performing a coordinate input operation for inputting coordinate information of an object designated by a user from among images displayed on the display unit. Displaying an object image group on the image display means based on the three-dimensional space information stored in the means; and, from the image displayed on the display means, the user specifies the object specified by the coordinate input means. Acquiring coordinate information, and the user designates from viewpoint / gaze direction information of the object image group stored in the information storage means and coordinate information of the object input from the coordinate input means. Image information processing method characterized by comprising the steps of: identifying a subject was, the. 2. The object is identified by determining the first intersection of a straight line connecting the coordinates of the viewpoint / viewing direction and the input coordinates with the input coordinate by geometric calculation in three dimensions. 2. The image information processing method according to claim 1, wherein an object is identified.