JP6079990B2 - Information processing apparatus, information processing method, and program - Google Patents

Description

  The present invention relates to information processing technology such as terrain / geological information.

Academic information such as topographical and geological information obtained through research studies is mainly output as topographical maps (topographical maps, geological maps, etc.), but interpretation often requires expertise.
The high-precision three-dimensional map production system described in Patent Document 1 converts numerical map data into STL data, and inputs the STL data to an optical modeling apparatus to produce a three-dimensional map. When automatically converting from numerical map data to STL data by a computer, a horizontal plane is set within the production range of the three-dimensional map, and a base point on this horizontal plane is adjacent to this grid point. Three grid points to be read, the altitude at each grid point is read from the numerical map CD-ROM, four new grid points are set above the grid points, and the four grid points are Dividing the quadrilateral to be divided into two triangles by diagonal lines, converting the aggregate of the divided triangles into STL data, and inputting this STL data into the stereolithography apparatus to form a three-dimensional map Therefore, the present invention provides a high-precision 3D map production system capable of producing a high-precision 3D map of an arbitrary area from numerical map data at low cost and in a short time.

  The invention described in Patent Document 2 includes a three-dimensional model made in a three-dimensional shape, one or more projectors for projecting an image on the three-dimensional model, and an image for supplying a video signal to the projector. A liquid crystal light control glass for projecting video / transmission from the projector between the supply device, the solid model and the projector and in the vicinity of the solid model, and turning on / off the liquid crystal light control glass It is an object of the present invention to provide a three-dimensional projection display device that allows a three-dimensional model and a plane image to be viewed without changing the viewpoint direction.

  In addition, the invention described in Patent Document 3 projects a planar image on part or all of irregular irregularities on the front and / or back of a stereoscopic surface, and controls the planar image to control the color of the stereoscopic image. A projection apparatus and method capable of flexibly responding to changes and capable of observing a stereoscopic image over a wide viewing zone. Although there is a concept that a planar image should be projected onto a plane, contrary to this existing concept, a stereoscopic image can be obtained by projecting a planar image onto a part or all of a surface including an uneven portion that is not a planar surface of a stereoscopic surface. .

JP 2006-48064 A JP 2010-197473 A JP 2002-268159 A

FIG. 8 is a flowchart showing an example of the process of the three-dimensional modeling process as in Patent Document 1. As shown in FIG. 8, first, processing is started (step S101), and in step S102, DEM (Digital Elevation Model, digital elevation model: numerical map, actual measurement data by aerial survey, etc.) is three-dimensionally using software. Convert to CAD data (DXF, STL, etc.).
In step S103, three-dimensional CAD data is input to a three-dimensional processing machine (NC or CNC machine tool, optical molding machine, lamination molding machine, etc.).
Next, in step S104, a tool path (data for instructing a path for moving the tool) or the like is generated, the processing machine is driven in accordance therewith, and a solid model is formed, thereby completing the process (step S105).

FIG. 9 is a general flowchart showing a flow of processing for creating and projecting an overlay image for the three-dimensional model created by the processing shown in FIG. As shown in FIG. 9, the process is started (step S111), and existing two-dimensional drawing data (two-dimensional map or the like) is collected in step S112. In step S113, the drawing is projected onto the modeled object in step S112 on the modeled object formed by the three-dimensional modeling process, and the process ends (step S114). In this case, since the three-dimensional shaped object and the two-dimensional drawing data are often inconsistent, the projection is performed with some deviation expected.
In this way, there has been a method for forming a three-dimensional model and projecting an image or video on its surface with a projector or the like.
However, these methods have a problem with accuracy when projecting high-definition drawings represented by topographic maps and geological maps onto a three-dimensional model and conducting, for example, academic research and presentations.
In addition, it takes time to process large volume data such as topographical information that is the basis of three-dimensional molding, and when it is actually three-dimensional molding, the time required for molding, dimensional stability, and cost problems There were many cases.
An object of the present invention is to improve the alignment accuracy of a high-definition drawing when it is projected onto a three-dimensional model.

According to one aspect of the present invention, the three-dimensional data or the two-dimensional drawing is used to match the coordinate system of the three-dimensional data and the two-dimensional drawing data projected onto the surface of the three-dimensional model based on the three-dimensional data. There is provided an information processing apparatus including a correction unit that corrects at least one of data. For example, a geometric correction unit that performs geometric correction of the two-dimensional drawing data may be provided. In this way, in the process of quickly and cost-effectively creating a high-precision solid model that can withstand projection, the shape data of land topography and underground structure, which is the basis of the solid model, and drawing data such as topographic maps and geological maps, Can be synchronized by preliminarily synchronizing with GIS using geometric correction and suppressing deviation during projection. The matching of the coordinate system and the like includes the case where the geometric distortion of the satellite photograph is corrected in the two-dimensional drawing data.
When contour data is given to the two-dimensional drawing data, a matching determination unit that performs matching determination between the three-dimensional data after correction processing and the two-dimensional drawing data based on the contour line data is provided. Is preferred. By processing smooth 3D shape data read into GIS etc. into 3D shape data with contour line information, the shape of the contour line on the 3D model and the contour line of various drawings are matched at the time of image projection. Projection accuracy can be improved.

When no contour line data is given to the two-dimensional drawing data, the three-dimensional data after correction processing and the two-dimensional drawing data are based on the data obtained by assigning the contour line data to the two-dimensional drawing data. It is preferable to have a matching determination unit that performs matching determination.
It is preferable that a stage color processing unit for adding a level line information to the three-dimensional data and performing a stage color process is provided in the previous stage of the matching determination unit. By processing smooth 3D shape data into 3D shape data having contour line information, the data is simplified and the processing efficiency is increased. In this case, the interval between the contour lines can be set arbitrarily, so that the practical accuracy can be prevented from being lowered despite being simplified.
As an example of two-dimensional drawing data (image data or the like) to which no contour line data is attached, satellite photographs and the like can be cited. In cases where it is not desirable to use contour data, it is not possible to use the contour line as a marker, so it has z-direction information and line information such as trunk lines and river channels (linear data). It is also possible to correct the distortion by using a plurality of point-like data including position information such as triangle points / level points or position information measured by GPS or the like at the site. In this case, it is not always necessary to have contour lines on the side of the three-dimensional model to be projected on the drawing. Rather, the above-described line information and point information may be formed on the three-dimensional model and used for matching. desirable.
As another correction method, multiple markers such as geometric patterns (for example, two-dimensional barcodes, AR markers, etc.) are installed in the margins of images and 3D models, and these markers are used for matching during projection. You can go.

It is preferable that a processing unit that converts the three-dimensional data that has been subjected to the gradation processing in the gradation processing unit into a gradation image having a contour line shape may be provided after the gradation processing unit. You may make it have a contour line width adjustment part which adjusts the width | variety of the said contour line data. While adjusting, the processing can be repeated to improve the matching accuracy.
Based on the two-dimensional drawing data and the line information or point information having z-direction information associated with the three-dimensional data, the matching determination between the corrected three-dimensional data and the two-dimensional drawing data is performed. You may make it have a matching determination part.
According to another aspect of the present invention, the three-dimensional data or the two-dimensional drawing is used to match the coordinate system between the three-dimensional data and the two-dimensional drawing data projected onto the surface of the three-dimensional model based on the three-dimensional data. A step of correcting at least one of the data, and a matching determination for performing a matching determination between the three-dimensional data and the two-dimensional drawing data based on the contour data in which the contour data is added to the two-dimensional drawing data There is provided an information processing method characterized by comprising steps.
The present invention may be a program for causing a computer to execute the information processing method described above, or a computer-readable recording medium for recording the program.

  Further, the present invention is a projection apparatus that projects an image based on the two-dimensional drawing data having the contour line data onto a projection target modeled based on the output of the information processing apparatus described above, wherein the contour line It is a projection device having a function of projecting an image based on the two-dimensional drawing data on the basis of the data on the three-dimensional surface of the projection object based on the contour lines.

  According to the present invention, when a high-definition drawing is projected onto a three-dimensional model, the alignment accuracy of both can be improved.

1 is a functional block diagram showing an example of the configuration of an information processing apparatus according to an embodiment of the present invention, which creates three-dimensional data for creating a projection model and two-dimensional figure (planar figure) data for projection It is a figure which shows the structural example of the process part to perform. It is a functional block diagram which shows the example of 1 structure of a projector system. It is a flowchart figure which shows the flow of the information processing in the information processing apparatus (GIS etc.) by this Embodiment. It is a flowchart figure which shows the flow of the information processing in the information processing apparatus (GIS etc.) by this Embodiment. It is a detailed flowchart figure which shows the flow of the information processing by the information processing method by the 2nd Embodiment of this invention. It is a figure which shows a mode that the smooth shape solid data is made into the solid shape data with the contour line information. It is a figure which shows the mode of the three-dimensional modeling process by an end mill. It is a figure which shows the mode of the projection of the two-dimensional figure data to the three-dimensional model by a projector. It is a flowchart figure which shows an example of a process of a three-dimensional modeling process like patent document 1. FIG. It is a general flowchart figure which shows the flow of the process which produces and projects the image for overlay based on two-dimensional figure data with respect to the solid model produced by the process etc. which are shown in FIG.

Hereinafter, with respect to the information processing technology according to the embodiment of the present invention, two-dimensional drawing data (planar graphic data) based on a two-dimensional drawing such as a topographic map and a geological map is projected onto a three-dimensionally modeled three-dimensional model. An example of information processing for generating three-dimensional data and two-dimensional drawing data will be described. The three-dimensional modeled three-dimensional model is a projection model, and the two-dimensional drawing data is projection data.
FIG. 1A is a functional block diagram showing a configuration example of an information processing apparatus according to an embodiment of the present invention. In this information processing apparatus A, these processes for generating three-dimensional (three-dimensional) data for creating a projection model and two-dimensional drawing data (planar graphic data) for projection are performed separately. Also good. FIG. 1B shows that projection data is generated based on the projection two-dimensional drawing data output from the information processing apparatus A for the projection model generated based on the three-dimensional data output from the information processing apparatus A. It is a functional block diagram showing an example of a configuration of a projector system that projects onto a projection model.

The information processing apparatus illustrated in FIG. 1A includes, for example, a geographic information system (GIS). GIS manages and processes data with geolocation information (geospatial information, spatial data, coordinate information, image information, etc.) comprehensively based on geographical location information, and displays it visually. It is a system that enables analysis and quick judgment, and can be realized by computer processing. The geospatial information refers to information (position information) indicating the position of a specific point or area in space and information related to various events associated therewith, or information including only position information. Geospatial information includes land use maps, geological maps, hazard maps, and other thematic maps, city planning maps, topographic maps, place name information, and ledger that express the situation on specific themes such as nature, disasters, and socioeconomic activities in the region. There are various information such as information, statistical information, aerial photographs, satellite images and so on.
The information processing apparatus A includes an input unit 1 for inputting a digital elevation model DEM and two-dimensional drawing data such as a geological map, and geometric correction of the two-dimensional drawing data according to the digital elevation model DEM input from the input unit 1 The geometric correction unit 3, the overlay determination unit 5 that overlays the digital elevation model DEM and the geometrically corrected two-dimensional drawing to determine consistency, and the gradation processing unit 7 that performs gradation processing on the digital elevation model DEM A matching determination unit 11 that performs a matching determination between the digital elevation model DEM after the stage color processing and the two-dimensional drawing, an output unit 15 that outputs the digital elevation model DEM after the step color processing and the two-dimensional drawing data, Have The contour line processing unit 7 is input with contour line information. The digital elevation model DEM data having the contour line shape output from the output unit 15 is used to create a projection model (x (latitude), y (longitude), z (elevation, altitude, etc.)), and a two-dimensional drawing. Data (x, y) is used to create projection data. The matching of the coordinate system and the like includes the case where the geometric distortion of the satellite photograph is corrected in the two-dimensional drawing data. The contour lines are illustrated as an index indicating the height in the z direction. Instead of the contour line, line information having information in the z direction, point information, or the like may be used as an index. Although the geometric correction unit 3 has shown an example in which the two-dimensional drawing data is corrected so that the coordinate axes of the digital elevation model DEM and the two-dimensional drawing data are matched, the correction unit may be a digital elevation model DEM (three-dimensional In order to match the coordinate system of the data) and the two-dimensional drawing data, at least one of the digital elevation model DEM (three-dimensional data) and the two-dimensional drawing data may be corrected.
The DEM is a digital elevation model, which is a digital representation of the land surface topography, and is often referred to as a digital terrain model (DTM). The topographic map is a map that uniformly represents all natural and artificial things on the surface of the earth, such as the heights and undulations of the land, rivers and lakes, vegetation, land use status, traffic routes, cities and other settlements (general map). ), A map with a certain level of detail is called a topographic map. The topographic maps of 1 / 250th and 1 / 50,000th published by the Geospatial Information Authority of Japan are representative. The geological map is a diagram that represents various geological structures such as faults and folds in addition to their distribution and cumulative relationship, by classifying various rock bodies in the surface layer of the crust according to their type, age, and lithology. Dansai means color coding for each altitude zone to make it easier to understand the topography. CAD is also referred to as computer-aided design and refers to performing design and the like using a computer. Or it refers to a design support tool using a computer.

  A projector system B shown in FIG. 1B includes a deviation correction unit that corrects a deviation between two-dimensional drawing data to be projected and a projection model based on contour line information, together with an input unit 21 and a projection unit 25 that are functions of a general projector. 23 may be included.

2 and 3 are flowcharts showing the flow of information processing in the information processing apparatus (such as GIS) according to the present embodiment. First, when processing is started (step S1), in step S2, the input unit 1 acquires a three-dimensional numerical elevation model DEM (x, y, z) and projection two-dimensional drawing data (x, y). Then, the information is input into the system of the information processing apparatus. In some cases, at least one of the three-dimensional digital elevation model DEM (x, y, z) and the projection two-dimensional drawing data (x, y) is created and used. In step S3, coordinates are given to the input DEM and the two-dimensional drawing data, and the geometric correction unit 3 performs geometric correction on the two-dimensional drawing data so as to match the digital elevation model DEM data. Enable to overlay dimensional drawing data as a layer. At this time, for example, the three-dimensional numerical elevation model DEM (x, y, z) and the projection two-dimensional drawing data (x, y) can be used as a projection standard by matching the four corners.
Geometric correction is correction to a two-dimensional drawing performed in order to match data when the coordinate system of the digital elevation model DEM and the two-dimensional drawing are different. For example, Helmet transformation, affine transformation, projective transformation, etc. 2D rotation conversion and 3D rotation conversion are included. It is also possible to take a correction method for converting the coordinate system on the DEM side and fitting it to the two-dimensional drawing side, or a correction method for converting both the DEM and the two-dimensional drawing to another coordinate system and fitting them. .
In step S4, the DEM and the two-dimensional drawing data are overlapped as layers, and in step S5, the overlay determination unit determines whether there is a shift. If there is a deviation in step S5 (Yes), the process returns to step S3 to further perform geometric correction of the two-dimensional drawing data. If there is no deviation (No: if it is a deviation within a certain allowable value), the process proceeds to step S6, and the gradation processing unit 7 performs gradation processing on the DEM based on the contour line information to add the contour line information, Create stage data. In step S <b> 7, the matching determination unit 11 determines the matching regarding the contour line data between the gradation processing data and the two-dimensional drawing. If it is not matched in step S8 (No), the process returns to step S3. If they are matched (Yes), the process proceeds to step S9, and the output unit 15 outputs the gradation processing data and the projection two-dimensional drawing data. Thereby, the process is terminated (S10). In FIG. 1A, you may have the contour line width setting part which sets the width of a contour line.

After step S2, if the DEM and the two-dimensional drawing data are different coordinate systems, as shown in FIG. 3, in step S2-1, it is determined whether or not there is a deviation between the DEM and the two-dimensional drawing. Only when there is, the geometric correction of the two-dimensional drawing may be performed in step S3 and then the process may proceed to step S4.
Through the above processing, the matched staged color processing data for projection modeling and the projection two-dimensional graphic data are output in a form that can be identified as a set by attaching an ID, for example, or a memory Etc. can be stored.
As described above, instead of using the contour line, an index representing the three-dimensional effect in the z direction, for example, line information (linear data) such as a trunk line or a river channel, position information such as a triangle point / level point, Or you may perform a correction process and a matching process on the basis of several point-like data containing point information, such as position information measured by GPS etc. in the field.

Next, an information processing method according to the second embodiment of the present invention will be described in detail with reference to the drawings. FIG. 4 is a detailed flowchart showing the flow of information processing according to this embodiment. The process shown in FIG. 4 partially overlaps with the process shown in FIG. 2, but has been further devised, and the details of the three-dimensional modeling process and the subsequent projection process are also specifically described. doing. FIG. 5 is a diagram showing a state in which smooth shape solid data is converted into solid shape data having contour line information. FIG. 6 is a diagram showing a state of three-dimensional modeling. FIG. 7 is a diagram showing a state of projection.
As shown in FIG. 4, when the process is started (step S21), in step S22, first of all, the land topography DEM (numerical elevation model: numerical map, measured data by aerial survey) and the tertiary structure of the underground structure are made prior to molding. Original data etc. and various drawing (topographic maps, geological maps, etc.) data used for projection are input to GIS. When the DEM is point cloud data, spatial interpolation is performed as necessary to convert the data into plane data. For the conversion, a geometric method such as TIN (Triangulated Irregular Network) or a method using a mathematical model such as a spline interpolation method, a weighted average method, or a kriging method is used.

In step S23, geographic coordinates are given to the input DEM and two-dimensional drawing data on the GIS. Since various coordinate systems such as geodetic systems are different, in order to have consistency, geometric correction is performed on the 2D drawing, the DEM and the 2D drawing data after geometric correction are overlaid as a layer, and overlay is used to ensure that there is no displacement. Check. At this time, the smooth three-dimensional shape data is processed into three-dimensional shape data having contour information (FIG. 5). Step S23 is processing corresponding to steps S3-S5 of FIG.
By performing this process, the data can be simplified and the data processing efficiency is improved. In addition, since the interval between contour lines can be set arbitrarily (eg, 0.002 mm to 1 mm or more), the practical accuracy does not decrease.

In step S24, the DEM layer performs gradation processing, adds contour line information, performs matching with each two-dimensional drawing data, and outputs, for example, a 24-bit grayscale gradation image. Data can be simplified by outputting as an image, but this process is optional. That is, in FIG. 1A, an image processing unit that converts the three-dimensional data subjected to the step color processing in the step color processing unit 7 into a stepped image having a contour line shape may be provided. Step S24 is processing corresponding to steps S7 to S9 in FIG.
In step S25, a 24-bit grayscale gradation image is converted into three-dimensional CAD data (DXF, STL, etc.) as the stereoscopic shape data. Originally smooth terrain data becomes data with contour lines.
In step S27, three-dimensional CAD data is input to a three-dimensional molding machine that performs three-dimensional molding. As shown in FIG. 6, for the three-dimensional molding, a cutting type molding machine excellent in cost, quickness, and dimensional stability can be used, but other molding machines can be applied. Here, time-consuming rough cutting is not performed, and finishing work can be performed from the beginning with an end mill having a large diameter and a long blade length. Next, finishing is performed again by a small diameter end mill (0.4 mm or less). When switching to a small-diameter end mill, the origin setting is lowered by 0.5 mm, and finishing work is performed to remove the thin skin on the surface. For example, a tool path is generated, a processing machine is driven in accordance with the tool path, and a three-dimensional model is formed. Rough cutting is not performed for shortening the cutting time and improving accuracy, and finish cutting is performed twice with two types of straight end mills (eg, large diameter 3 mm, small diameter 0.4 mm or less). The operation direction of grinding may be repeated operation in the same direction as shown in FIG.

On the other hand, in step S29, the two-dimensional drawing data layer used for projection is output as a full-color image. If the contour data is not included in the two-dimensional drawing data, the contour data is acquired and added to the two-dimensional drawing data (L1). In step S30, the image of the drawing is input to the projector or converted into an image film using an image transfer film or the like.
In step S31, two-dimensional drawing data based on various drawings in which the coordinate system is preliminarily matched on the GIS is projected on the surface of the molded three-dimensional model by a projector, or an image formed into a film is covered to form three-dimensional information. . If this method is used, a projection or covering result without deviation can be obtained. In practice, however, slight deviations in millimeters or less occur due to tilt of the projector, distortion of the frame that supports the projector, or differences in partial elongation of the film.
In order to correct this, the final projection or covering accuracy is improved by matching the shape of the contour line on the three-dimensional model with the contour line of the 2D drawing data based on various drawings and actively synchronizing them. (Fig. 7).

As described above, for example, a high-precision three-dimensional model is formed, and academic information such as geological data and topographic data is projected onto the surface of the three-dimensional model with a projector, etc. Can be intuitively understood.
In this embodiment, an example in which the altitude z is positive in the coordinates (x, y, z) of the DEM has been described. However, it goes without saying that the present invention can also be applied to the case where the altitude z is negative, that is, underground or the seabed. Yes.
As an example of two-dimensional drawing data (image data or the like) to which no contour line data is attached, satellite photographs and the like can be cited. In cases where it is not desirable to use contour data, it is not possible to use the contour line as a marker, so it has z-direction information and line information such as trunk lines and river channels (linear data). It is also possible to correct the distortion by using a plurality of point-like data including position information such as triangle points / level points or position information measured by GPS or the like at the site. In this case, it is not always necessary to have contour lines on the side of the three-dimensional model to be projected on the drawing. Rather, the above-described line information and point information may be formed on the three-dimensional model and used for matching. desirable.
As another correction method, multiple geometrical markers (for example, two-dimensional barcodes, AR markers, etc.) are installed in the margins of images and 3D models, and these markers are used for matching during projection. May be.
In the above-described embodiment, the configuration and the like illustrated in the accompanying drawings are not limited to these, and can be appropriately changed within a range in which the effect of the present invention is exhibited. In addition, various modifications can be made without departing from the scope of the object of the present invention. Each component of the present invention can be arbitrarily selected, and an invention having a selected configuration is also included in the present invention.
In addition, a program for realizing the functions described in the present embodiment is recorded on a computer-readable recording medium, and the program recorded on the recording medium is read into a computer system and executed to execute processing of each unit. May be performed.

  The present invention can be used as an information processing apparatus.

A ... Information processing device, 1 ... input unit, 3 ... geometric correction unit, 5 ... overlay determination unit, 7 ... gradation processing unit, 11 ... matching determination unit, 15 ... output unit.

Claims (8)

In order to match the coordinate system between the three-dimensional data and the two-dimensional drawing data projected onto the surface of the three-dimensional model based on the three-dimensional data, at least one of the three-dimensional data and the two-dimensional drawing data is corrected. A correction unit to perform,
When contour data is given to the two-dimensional drawing data, a matching determination unit that performs matching determination between the three-dimensional data after correction processing and the two-dimensional drawing data based on the contour line data is provided. An information processing apparatus characterized by the above . In order to match the coordinate system between the three-dimensional data and the two-dimensional drawing data projected onto the surface of the three-dimensional model based on the three-dimensional data, at least one of the three-dimensional data and the two-dimensional drawing data is corrected. A correction unit to perform,
When no contour line data is given to the two-dimensional drawing data, the three-dimensional data after correction processing and the two-dimensional drawing data are based on the data obtained by assigning the contour line data to the two-dimensional drawing data. An information processing apparatus comprising: a matching determination unit that performs matching determination. Before the matching determination unit,
The information processing apparatus according to claim 1 or 2, characterized in that it has a Dan'irodori processing unit that performs Dan'irodori process by adding contour information on the three-dimensional data. After the stage color processing unit,
The information processing apparatus according to claim 3 , further comprising: an image processing unit that converts the three-dimensional data subjected to the step color processing in the step color processing unit into a stepped image having a contour line shape. The information processing apparatus according to any one of claims 1 to 4, characterized in that it comprises a contour width adjusting unit for adjusting the width of the contour line data. Correction of at least one of the three-dimensional data and the two-dimensional drawing data is performed in order to match the coordinate system between the three-dimensional data and the two-dimensional drawing data projected onto the surface of the three-dimensional model based on the three-dimensional data. Steps,
An information processing method comprising: a matching determination step for performing a matching determination between the three-dimensional data and the two-dimensional drawing data based on contour line data in which contour line data is added to the two-dimensional drawing data. A program for causing a computer to execute the information processing method according to claim 6 . A projection device that projects an image based on the two-dimensional drawing data having the contour line data onto a projection target modeled based on the output of the information processing device according to any one of claims 1 to 5. And
A projection apparatus having a function of projecting an image based on the two-dimensional drawing data on the three-dimensional surface of the projection object based on the contour line data, using the contour line as a reference.

Images