JP3002666B2 - House coordination support system and recording medium - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a house coordination support system for assisting coordination by coordinating the exterior of a house or the like by displaying color patterns so that good reproducibility can be obtained.

[0002]

2. Description of the Related Art The main components forming the exterior of a house are a wall portion that borders the side peripheral portion and a roof portion that borders the upper atmosphere. The walls are further fitted with windows and doors, and sometimes the roof is fitted with ceiling-lit windows. For a user who wants to build a new house or renovate, before deciding to make a purchase, everybody imagines what the house will look like. At that time, the model house is useful for forming a real image.

In recent years, several support systems capable of performing simulations of coordination in the interior and exterior fields using a CAD system have been developed and already implemented (examples of exterior simulations are shown in FIGS. 16 and 17). . For example, Japanese Patent Application Laid-Open No. 9-3
No. 17206 discloses a “building renovation support device” that can be used when designing a house when renovating the house.

[0004]

However, in the case of a model house, the selection of the color pattern of the exterior panel and roofing material to be attached is imagined in the model house with reference to printed materials such as catalogs and small actual samples. Is easy at first glance, but in reality it is a difficult task for someone who has no knowledge of the subject. When conducting exterior simulation, the target object (building)
Is an important evaluation item,
Even when using a CAD system, it is difficult to say that satisfactory results are always obtained for the user.

[0005] One of the possible causes is as follows.
Since the color / pattern data to be pasted on the designated area is obtained from printed materials such as catalogs or photographs, the printing conditions and photographing conditions, and the performance differences of image data obtaining means (scanners, etc.) At present, it is undeniable that color pattern reproducibility is inadequate due to the factors that come from.

Another possible cause is that:
Although the object (building) drawn on the screen is a scaled image, the image data to be pasted on the specified area is obtained from image data obtained by commercially available texture reading software (specifically, The information about the rough pattern and color) is simply sized and pasted in the pasting area. For this reason, a color correction operation after the operation by the CAD operator (which is completely the same as a manual operation using a paintbrush) is absolutely necessary at present.

[0007] However, even with such a correction work, it is inevitable that the overall image will inevitably become dramatic. Although this functions as a service purpose of exterior coordination for beginners, it does not form a satisfactory image for users who have increased eyes. The present invention
In view of the above problems, it is an object of the present invention to provide a system for supporting house coordination in which good reproducibility of a color pattern is obtained when coordinating a house.

[0008]

Means for Solving the Problems] house coordinate support system of the present invention, image building materials surface design from a plurality of directions
Each of the image data is converted to a three-dimensional image
An image memory for storing in association with each building materials as over data,
A building material selecting means for selecting a building material to be displayed from a plurality of building materials for a specific area of the house, and the stereoscopic image data of the building material selected by the building material selecting means is read out from the image memory and the selected building material is selected. The image processing apparatus includes image calculation means for calculating display image data from a direction in which a building material is observed, and display means for displaying the calculated display image data in the area of the house.

[0009] Also, the image memory has four colors on the surface of the building material.
By accumulating the above image data, building materials
Accurate color information of the surface can be stored. Also,
An image memory stores the stereoscopic image data for different illumination sources.
By accumulating data, you can respond to different times and weather.
And can reproduce the house with appropriate lighting
You.

The building material selecting means can select different building materials for each of the plurality of areas, so that a variety of houses can be reproduced. Further, the image calculation means calculates the display image data according to the distance from the building material to be displayed to the position where the house is observed, so that the surface of the building material with a real feeling can be reproduced. Further, by providing direction input means for inputting the direction in which the house is observed, the house can be reproduced from various angles. Further, by providing a distance input unit for inputting a distance for observing the house, the house can be reproduced from various visual distances. Further, the present invention is a recording medium in which a program for causing a computer to function as the house coordination support system is recorded.

[0011]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Preferred embodiments of the present invention will be described below in detail with reference to the accompanying drawings. FIG. 1 schematically shows an example of the surface of a building board 21 for acquiring, accumulating, and displaying image data by a house coordination support system according to an embodiment of the present invention. Here, a pattern pattern on the surface of the building board 21 having the convex portions 23 divided by the groove portions 22 passing in the vertical and horizontal directions is shown. The surface of the convex portion 23 is painted in two colors as a whole plate, and the surface portion of each convex portion 23 is
In addition to the two-color fine spot pattern formed by the sputter coating, fine particle projections (both not shown) having an aggregate color formed by spraying the aggregate are formed. Therefore, in the case of this example, the number of colors of the entire plate is the groove color, the convex color, and the speckle color.
A total of six colors, color and aggregate color, are displayed.

A spot pattern is formed on the surface by two-color sputter coating. As the number of colors, a total of four colors, that is, two colors of a groove color, a convex color, and a spot portion, are displayed. 2 and 3
Shows an example of the texture of the exterior panel and the roofing material, each of which is acquired as a basic image. Basic image data is acquired from these real objects and stored in a file.

As described above, the image data to be pasted is to be prepared as basic data for simulation of exterior coordination (applicable to all applicable exterior fields). Instead, the exterior material itself is targeted for image data acquisition. Then, when acquiring the image data, data from several photographing angles is acquired. As a result, it is possible to reproduce a portion projected in an oblique direction. Furthermore, it is possible to cope with the projection in the middle direction of the photographing angle by performing interpolation by taking a weighted average of a plurality of data.

FIGS. 4 and 5 show examples of photographs of a building taken as an object for executing an exterior simulation, which are stored in a file as default data. In this case, the photographing direction and the actual size of the linear portion to be used as a reference are grasped, and corresponding data is stored. In addition,
Instead of photographs, CAD software may be used to create and store three-dimensional drawings of various building patterns. When such a drawing is performed, it is also possible to rotate the building image by affine transformation to change the observation direction and perform a simulation.

FIG. 6A shows an example (approximately 10 degrees) of the viewing angle of the current TV. In FIG. 6B, the rightmost arrow is
It is shown as a symbol representing the height of the entire exterior of the building. The observation position P _S is located at a distance l ₁ from the position P ₀ of the building, and is a position where the surface pattern of the exterior plate can be clearly identified. The image of the exterior plate captured at this position is used as the basic image data. To get as Observation position P ₁ ~P _n is, when performing the exterior simulate, or close to the building, and shows the range of movement of the order to realize the feeling of when you or away from, the place from the position P _S of the distance l ₂ and farthest observation position P _n, and nearest observation position P ₁ a at a distance l ₃ from here. In a normal support system, the user moves within the field of view where the highest point of the roof can be seen.

FIG. 7C shows the correspondence between the actual height of the building projected on the screen and the observation positions P _{1 to} P _n . That is, in response to the observation position P ₁ to P _n, in accordance with the scale ratio, the size of the arrow will change in the screen. FIG. 7D shows this as a change in the two-dimensional image. Here, the resolution of the display is also displayed. That is, since the resolutions are the same, boards of different sizes (the same object) are represented by different numbers of pixels.

Also, in this embodiment, most of the building boards 21 pay attention to the fact that the surface design has some periodicity as shown in FIG. It is assumed that fast Fourier transform (FFT) is performed on the acquired basic image data. The discrete Fourier transform F (u, v) is defined by the following equation for a finite image f (m, n) having M × N samples.

[0018]

(Equation 1)

By doing so, it becomes possible to handle the visual image after converting it into a frequency image, and it is possible to store data compactly without losing the feeling of speckles, unevenness or graininess. .

FIG. 8 shows the relationship between the pixel array of the display and the frequency space in the Fourier transform. A periodic two-dimensional image of a spot pattern having a horizontal interval of a and a vertical interval of b is confined in a specific frequency space centered on a horizontal frequency k / a and a vertical frequency k / b (k is a constant). You can see that. In this way, based on the image data is acquired is converted into the Fourier transform data. The building image projected on the screen is reduced in scale, and the image data to be pasted on a part thereof is also reduced in scale. Therefore, at the time of display, the spatial frequency is changed according to the contraction scale.

More specifically, first, a virtual visual distance between the person staring at the display and the display building in the screen is calculated from the scale ratio to the actual size of the target house displayed on the display. based on the calculated values, navigate to the spatial frequency corresponding to the scale ratio by frequency shifting the FFT data, and inverse Fourier transform F FT data, an inverse Fourier <br/> et converted signal, screen To the specified area. The inverse Fourier transform is defined by the following equation.

[0022]

(Equation 2)

Thus, the designated area on the screen is
A realistic image is reproduced. Furthermore, when looking at a real house, the reflected light from a naturally illuminated object is recognized as a color pattern, so that as a representative light source of natural light that becomes illumination light when acquiring basic data, , D ₆₅ is a standard light source is realized (light from Sunny north window), C (cloudy light), using a B (direct sunlight). These light sources are sequentially switched to shoot, accumulate data,
At the time of display, data can be switched by switching a switch or the like to reproduce the appearance of the object when the illumination light changes.

Next, regarding the acquisition of color data, it is basically possible to acquire the minimum necessary color data by photographing with a commercially available high-resolution digital camera. However, in general, digital cameras
The color information is less than the luminance information and is not always sufficient. Therefore, in the present embodiment, the spectral reflectance from the target object is measured in order to obtain more accurate color information of the basic image data.

Specifically, eight multispectral images are obtained by using eight color filters. Then, from these eight acquired multispectral images,
Obtain vector image data. The vector includes position information and luminance information of a pixel in the imaging screen for each spectrum (color component) wavelength. This relationship is expressed by the following equation. F (x, y) ≡ (f ₁ (x, y), f ₂ (x, y),..., F ₈ (x, y)) Display from the stored vector image data F (x, y). To convert to RGB, first, CI
The tristimulus value XYZ of the XYZ color system of E is obtained. In the present invention, the acquired eight multispectral image data may be added.

[0026] _{X = k∫ VIS R (λ)} P (λ) x (λ) dλ Y = k∫ VIS R (λ) P (λ) y (λ) dλ Z = k∫ VIS R (λ) P ( λ) z (λ) dλ k = 100 / ∫ _VIS P (λ) y (λ) dλ ∫ _VIS : integral in the visible wavelength region R (λ): spectral reflectance P (λ): standard light as illumination light X (λ), y (λ), z (λ): spectral tristimulus values

Next, the tristimulus values XYZ are converted into RGB values based on the following relational expression. X = 2.7689R + 1.7517G + 1.1302B Y = 1.0000R + 4.5907G + 0.0601B Z = 0.0000R + 0.0565G + 5.5943B Paste to the designated area on the screen according to the RGB values obtained in this manner by a conventional method. Reproduce the color pattern. Here, for the sake of convenience, the characteristics of the display are not taken into account.

Next, as to the illuminance (density of the light flux projected on a unit area), as shown in FIG. 9A, the wall surface is a vertical surface, and the roof surface is a typical inclined surface. An illuminance curve for one day is created (by an illuminometer) and data is stored. As this type of data, for example, monthly data on a sunny day on each of 22 days from January to December is stored. Furthermore, correction based on the weather content can be performed with reference to the data table shown in FIG. In the case of natural light, since the light source becomes very large, the illuminance is independent of the distance and is proportional to only the luminance of the light source.

The correction taking into account the illuminance is performed by f, which is a component of a vector image obtained by dividing and sensing information on a single object described above for each wavelength.
For (x, y), f (x, y) = r (x, y) · h (x, y) r (x, y): Reflection coefficient of object h (x, y): Illumination intensity Because there is. Also, regarding the shade, the direction and elevation angle of the sun position are calculated by calculating the diurnal motion of the sun in consideration of the seasonal variation of the sun.
The shade can be calculated.

FIG. 10A is a diagram showing a system configuration according to the present embodiment. Image data photographed by the digital camera 20 specific to the present embodiment (detailed in FIG. 11) is stored in the image memory 2 and processed by the image processing computer 1. It is stored in the data file 3, if it is a background, it is stored in a background pattern data file 4, and if it is a texture, it is stored in a texture data file 5.

With respect to the shade calculation, the original data from which the shade calculation can be performed by determining the direction and the elevation angle of the sun position with respect to the season, month, day, and time are calculated as shade calculation data.
It is stored in file 6. Regarding the illuminance calculation, the illuminance for the vertical plane and the inclined plane and the correction value due to the weather for the season, month, day, and time are accumulated in the illuminance calculation data file 7.

A display 9 for displaying data, a keyboard 10 for inputting necessary data, and a mouse 11 for operating a cursor on the display 9 are connected to the image processing computer 1, and a CAD set 12 is incorporated therein. . FIG. 10B shows an example of the display 9, in which a house is displayed and a slide switch 13 for changing a visual distance is displayed. The slide position can be moved by the cursor movement key of the keyboard 10 or the mouse 11.

FIG. 11 is a configuration diagram of the digital camera 20. The light reflected by the building board 21 is a digital camera 20
From the imaging lens 33 of the rotary disk R with color filters
The light passes through P and further passes through an optical low-pass filter 34 to avoid aliasing distortion caused by sampling, and reaches a CCD imaging device array matrix 35. This CCD
The imaging device array matrix 35 includes the CCD driving circuit 3
The data driven by the CCD 6 and obtained by the CCD imaging device array matrix 35 is sent to an electronic circuit 37. The data received by the electronic circuit 37 is converted by the A / D converter 3
At 8, the analog signal is converted into a digital signal and stored in the image memory 39. On the other hand, the CCD camera controller CC controls the M1 stepping motor 42, the M2 stepping motor 43, and the M3 stepping motor 44 via the motor drive circuit 41. These motors can perform precise position control by micro-step control. The M1 stepping motor 42 is for auto-focusing of the imaging lens 33, and the M2 stepping motor 43 is for controlling the rotation of the rotating disk RP with color filters. , M3 stepping motor 44 is CCD
It is used to move the imaging device array matrix 35. Accordingly, the CCD drive circuit 36 and the electronic circuit 3
The wiring with 7 is a flexible wiring. The data collected by the digital camera 20 is transmitted to the image processing computer 1 via the input / output interface 40. A control signal from the image processing computer 1 is transmitted to the CCD camera controller CC via the input / output interface 40.

In the present invention, it is assumed that the spectral reflectance is obtained in place of the ordinary digital camera specification in order to measure the color of the building board 21. Then, colors are digitized based on the acquired spectral reflectance data. The present invention relates to a digital camera 2
A method called multiband photography is applied to 0. According to the multi-band photography, color information of a subject is recorded on a panchromatic film (a photographic film sensitive to light of all colors) through a plurality of channels having different spectral sensitivities. Thereafter, the densities of the plurality of panchromatic films are read by a color scanner, and the spectral reflectance of the subject is restored from the information.
In this case, the number of channels is desirably about 8 channels (that is, to reproduce the original color).

In the present invention, a matrix 35 composed of a large number of CCD image pickup devices built in the digital camera 20 is regarded as a panchromatic film, and reflected light from the building board 21 entering through the image pickup lens 33 is converted into eight color filters. The channel was configured to pass through CH1 to CH8 in order. FIG. 12 shows a rotating disk RP having these eight channels.
FIG. The rotating disk RP is provided with eight channels CH1 to CH8 each having a color filter attached thereto, and a hole CH0 which is not provided with a color filter. Here, the eight channels to which the color filters are attached are configured as follows.

Visible light wavelength range 380 nm to 780 nm
At 50 nm intervals, 380-430 nm (purple range) → 1CH 430-480 nm (blue range) → 2CH 480-530 nm (green range) → 3CH 530-580 nm (yellow range) → 4CH 580-630 nm (orange range) → 5CH 630-680 nm (first red range) → 6CH 680-730 nm (second red range) → 7CH 730-780 nm (third red range) → 8CH

Using these eight channels as the sampling wavelength range of the spectral reflectance data, a spectral image of one screen imaged for each channel is taken as a CCD image pickup device array matrix 35 (for example, having an 800 × 500 pixel configuration). Image on top. The spectral image for one screen obtained here has information on luminance color data as the spectral reflectance of each pixel (having positional information in one plane on one plane) constituting one captured screen.

The CCD image pickup device 35 used is an all-pixel read-out IT-CCD (interline transfer CC).
D). That is, in this device, three electrodes of the vertical transfer CCD correspond to one photodiode, and the signals of all the photodiodes are read at one time. Therefore, it has the feature that the vertical resolution of a still image can be increased. Thus, in the present invention, eight pieces of spectral image information are acquired. A multiplexed spectral image obtained by multiplexing these spectral images displays the measurement object.

Further, in addition to the above-described 8CH color filter configuration, a hole without a color filter is provided as CH0 in order to obtain luminance information. When obtaining the luminance information, the CCD RP is moved by the M3 stepping motor 44 to control the rotation of the disk RP to match CH0, and to adjust the optical path length as much as there is no color filter. The color information and the luminance information are obtained by time division.

FIG. 13 is a control flowchart for acquiring basic image data. First, in step S1, the building board 21 is illuminated by selecting a light source from D ₆₅ (light from a window in the clear north), C (cloudy sky), and B (direct sunlight). Then, the inclination of the building board 21 at step S2, by setting the distance of the digital camera 20 to the surface design of clearly identifiable location of the building board 21 (P _S in FIG. 6 (b)), monochrome image And eight multispectral images are captured and data is input to the image memory 39. This is input to the image memory 2 via the CCD camera controller CC, the input / output interface 40, and the image processing computer 1, and the image processing computer 1 in step S3
FFT is performed on the image data . Then, accumulate in the texture data file 5 with a code number of the execution result Ru der Fourier transform signal in step S 4.
Then, image data is similarly acquired for different inclinations of the building board 21. Image data from multiple directions of the building material surface
Data is stored as stereoscopic image data.

FIG. 14 is a flowchart for explaining the operation of the exterior simulation. First, it is determined whether or not the system power is ON (step S11). If NO, the process waits until the system power is turned ON. If YES, initial settings such as data including settings for receiving measurement data from the digital camera 20 are performed (step S12). Next, in step S13, it is determined whether or not there is an input for designating the appearance pattern of the house. If YES, the corresponding pattern is searched and displayed on the display 9 (step S1).
4) Then, the reduction scale is calculated (step S15).

In step S16, it is determined whether or not there is an input for designating an area to be displayed, a light source, and a texture.
If NO, it waits until there is a designated input. If YES, the corresponding pattern of the observation angle corresponding to the area to be displayed is searched, and the signal is converted into F (x, y) ⇒ XYZ ⇒ RGB, and correction calculation based on the reduction scale (that is, frequency shift)
It was a signal from an inverse Fourier transform, de Isupurei 9
(Step S17). If there is no corresponding pattern of a suitable observation angle, a pattern of a suitable observation angle may be created from a plurality of patterns by interpolation.

In step S18, the observation direction, month, day,
At this time, it is determined whether or not there is an input for designating the weather. If yes,
First, the illuminance is corrected (step S19), the shade is corrected (step S20), and the calculation result is displayed on the display 9 (step S21). Step S2
In step 2, it is determined whether or not there is an input for designating a background pattern. YE
If S, the background pattern is searched and pasted on the background and displayed (step S23).

In step S24, it is determined whether or not the house pattern being processed is a photograph.
The process proceeds to step S7, and if NO, it is determined in step S25 whether or not the designation of the observation direction is changed. If NO, the process waits until there is a designation input. If YES, the house pattern is rotated in the designated direction by the affine transformation (step S26). At this time, since the observation direction is changed, “illuminance correction calculation” in step S19 and “shade calculation” in step S20 are performed again. In step S27, it is determined whether or not there is an input for designating an area. If yes,
The process waits for the next designation input (step S28), shifts to processing of the designated item (step S29), and ends the process.

FIG. 15 is a processing flow diagram when it is desired to see a change in appearance when approaching or leaving a house.
In step S31, it is determined whether or not the slide switch 13 is ON. If NO, the process waits until the switch is turned ON. If YES, the visual distance is calculated according to the slide switch 13 for changing the visual distance (step S).
32). In step S33, the Fourier transform data is frequency-shifted according to the visual distance, and texture correction calculation is performed. In step S34, a calculation for correcting the shade and a calculation for correcting the background are executed. Step S3
In 5, the house is displayed on the display 9 based on the above calculation result. Note that the present invention is not limited to the above embodiment.

The present invention can be used not only for exterior simulation but also for interior simulation. The number of multispectral images is not limited to eight. If three, it works, but four or more are desirable. Moreover, the computer-readable recording medium which recorded the program for functioning a computer as the said house coordination support system may be sufficient.

[0047]

As described above, according to the present invention, it is possible to display a building material pattern according to the observation direction. For this reason, in the house coordination support system, a house with a real feeling can be reproduced.

[Brief description of the drawings]

FIG. 1 is a diagram showing an example of the surface of a building board.

FIG. 2 is a diagram showing an example of a texture of an exterior plate.

FIG. 3 is a diagram showing an example of a texture of a roofing material.

FIG. 4 is a view showing an example of a photograph of a building (part 1).

FIG. 5 is a view showing an example of a photograph of a building (part 2).

FIG. 6 is a view for explaining a scale relationship of an image (part 1).

FIG. 7 is a view for explaining a scale relationship of an image (part 2).

FIG. 8 is a diagram illustrating a Fourier transform.

FIG. 9 illustrates a change in illuminance.

FIG. 10 is a diagram showing a system configuration according to an embodiment of the present invention.

FIG. 11 is a diagram showing a digital camera according to an embodiment of the present invention.

FIG. 12 is a diagram showing a rotating disk according to one embodiment of the present invention.

FIG. 13 is a flowchart showing an image data acquisition operation according to an embodiment of the present invention.

FIG. 14 is a flowchart showing an exterior simulation operation according to the embodiment of the present invention.

FIG. 15 is a flowchart showing a distance changing operation according to the embodiment of the present invention.

FIG. 16 shows an example of a conventional exterior simulation (part 1).

FIG. 17 is a view showing an example of a conventional exterior simulation (part 2).

[Explanation of symbols]

 3 House outdoor view pattern data file 4 Background pattern data file 5 Texture data file 6 Shade calculation data file 7 Illuminance calculation data file 9 Display 13 Slide switch 20 Digital camera 21 Building board 22 Groove 23 Convex part 33 Shooting lens 34 Optical low-pass filter 35 CCD imaging device array matrix 42 M1 stepping motor 43 M2 stepping motor 44 M3 stepping motor RP Rotating disk

Claims (8)

(57) [Claims] An image data of a surface pattern of a building material from a plurality of directions.
Data in the form of Fourier transform
To an image memory for storing in correspondence with each building material, a building material selecting means for selecting the building materials to be displayed to a specific area of a house from a plurality of building materials, the building materials selected by該建material selection means Image calculation means for reading the stereoscopic image data from the image memory and calculating display image data from a direction in which the selected building material is observed, and display means for displaying the calculated display image data in the area of the house A house coordination support system comprising: 2. The house coordination support system according to claim 1, wherein said image memory stores image data of four or more colors of a building material surface. 3. The house coordination support system according to claim 1, wherein the image memory stores the stereoscopic image data for different illumination sources. 4. The house coordination support system according to claim 1, wherein said building material selecting means can select different building materials for each of the plurality of areas. 5. The house coordination support system according to claim 1, wherein said image calculation means calculates display image data according to a distance from a building material to be displayed to a position at which the house is observed. 6. The house coordination support system according to claim 1, further comprising direction input means for inputting a direction of observing the house. 7. The house coordination support system according to claim 5 , further comprising distance input means for inputting a distance for observing the house. 8. A computer-readable recording medium characterized by recording a program for causing a computer to function as a house co-ordinate support system according to any one of claims 1 to 7.