JP4808975B2 - Simulation apparatus and simulation method for evaluating and simulating skin unevenness - Google Patents

Description

  The present invention relates to a simulation apparatus and a simulation method for evaluating and simulating an uneven state of skin, and more particularly to a simulation apparatus and a simulation method for creating a three-dimensional image from three-dimensional point cloud data representing the uneven state of skin.

For example, as a method for evaluating the uneven state of the skin, there has been an evaluation method using a skin replica (see Patent Document 1). The skin replica referred to here is a sample obtained by applying a replica agent to the skin and separating the replica agent from the skin after drying. The skin replica is an effective method for representing the uneven state of the skin.
JP-A-5-317292

  The skin replica represents an actual skin state, and can express the uneven state of the skin without much cost. However, the skin replica hardens with time and changes its shape. Therefore, the skin replica has a problem that it is not easy to handle and store.

  The present invention has been made in view of the above points, and an object thereof is to provide a simulation apparatus and a simulation method that are easy to handle and that can easily evaluate and simulate the uneven state of the skin.

In order to solve the above problems, the present invention is a simulation apparatus for evaluating and simulating the uneven state of the skin, and an environmental condition setting means for setting environmental conditions including the viewpoint and the position of the light source according to a request from the user And three-dimensional image creation means for creating a three-dimensional image simulating the skin roughness evaluation and shading according to the three-dimensional point cloud data representing the skin roughness and the environmental conditions. The position of the light source is changed in latitude to express the state of the skin dermis, or the position of the light source is changed in longitude to express the texture state .

  The three-dimensional image creation means may be characterized by simulating shade, shadow and penumbra states.

  It is good also as connected to the measuring means which measures the three-dimensional point cloud data showing the uneven state of the skin, and may acquire the three-dimensional point cloud data from the measuring means.

  A presentation means for presenting the environmental condition to the user together with the three-dimensional image may be further provided.

  The skin may be classified according to the skin dermis and texture, and product information associated with the classification may be presented.

Further, the present invention is a simulation method for evaluating and simulating the uneven state of the skin, wherein the computer sets environmental conditions including the viewpoint and the position of the light source according to a request from the user, and the unevenness of the skin Performing three-dimensional point cloud data representing information and a step of creating a three-dimensional image simulating the unevenness state of the skin and the state of shadow according to the environmental conditions, and determining the position of the light source in terms of latitude The state of the skin dermis is changed to change, or the position of the light source is changed in longitude to express the texture state .

  In the present invention, the unevenness state of the skin is held as three-dimensional point cloud data, and a three-dimensional image that simulates the evaluation of the unevenness state of the skin and the shadow state is created according to the point cloud data and environmental conditions. . By holding the uneven state of the skin with three-dimensional point cloud data, the handling becomes easy. Further, according to the present invention, it is possible to easily create a three-dimensional image that simulates the evaluation of the uneven state of the skin and the state of shadow according to the point cloud data and the environmental conditions.

  According to the present invention, it is possible to provide a simulation apparatus and a simulation method that are easy to handle and that can easily evaluate and simulate the uneven state of the skin.

  Next, the best mode for carrying out the present invention will be described based on the following embodiments with reference to the drawings.

  FIG. 1 is a block diagram of an embodiment of a simulation system according to the present invention. The simulation system in FIG. 1 includes a simulation device 1 and a measurement device 2. The simulation device 1 is connected to the measurement device 2.

  FIG. 2 is a hardware configuration diagram of an example for realizing the simulation apparatus 1. 2 includes an input device 11, an output device 12, a drive device 13, an auxiliary storage device 14, a memory device 15, an arithmetic processing device 16, and an interconnection device connected to each other via a bus B. An interface device 17 and a database (hereinafter referred to as DB) 18 are provided. Note that various devices constituting the simulation apparatus 1 of FIG. 2 may be housed in one housing or may be housed in a plurality of housings.

  The input device 11 includes a keyboard, a mouse, and the like, and is used for inputting various operation instructions. The output device 12 includes a display and displays various windows and data necessary for operation. The interface device 17 is an interface for connecting to the measuring device 2.

  A program for controlling the simulation apparatus 1 is provided by a recording medium 19 such as a CD-ROM. The recording medium 19 is set in the drive device 13, and the program is installed from the recording medium 19 to the auxiliary storage device 14 via the drive device 13. The recording medium 19 on which the program is recorded is a recording medium that records information optically, electrically, or magnetically, such as a CD-ROM, flexible disk, magneto-optical disk (MO), or ROM, flash memory, etc. As described above, various types of recording media such as a semiconductor memory for electrically recording information can be used.

  The program also includes a program recorded on a recording medium of another computer connected via a network (not shown). A program recorded in a recording medium or the like of another computer is downloaded via a network and installed in the auxiliary storage device 14. The auxiliary storage device 14 stores the installed program and various files necessary for processing the program.

  The memory device 15 reads the program from the auxiliary storage device 14 and stores it. The arithmetic processing device 16 implements various processes or means of the simulation device 1 according to a program stored in the memory device 15.

  FIG. 3 is an image diagram of an example of a laser scanner. The laser scanner is an example of the measuring device 2. The laser scanner can acquire a three-dimensional point cloud data representing a skin unevenness state by sampling a skin replica described later. The measuring device 2 is not limited to the laser scanner, and may be any device that can acquire three-dimensional point cloud data representing the uneven state of the skin.

  FIG. 4 is a flowchart showing the steps of the simulation method according to the present invention. Proceeding to step S1, the point cloud data representing the uneven state of the skin is acquired. For example, the point cloud data is obtained by collecting the skin replica 21 as shown in FIG. 5 and sampling the skin replica 21 with the laser scanner of FIG. Can be obtained. By storing the skin replica 21 as digitized point cloud data, it is easier to handle than when storing the skin replica 21 as it is, and the storage space can be narrow.

  FIG. 5 is an image diagram of an example of the skin replica 21. The skin replica 21 in FIG. 5 is obtained by applying the replica agent to the skin of a model or the like, and separating the replica agent from the skin of the model or the like after the replica agent is dried. On one surface of the skin replica 21, the uneven state of the skin is represented.

  The collected skin replica 21 of FIG. 5 is set in the laser scanner of FIG. 3 and sampled. In many cases, the skin replica 21 is not flat on the application surface (the opposite surface on which the uneven state of the skin is represented). Therefore, it is desirable to perform a smoothing process for removing the inclination of the skin replica 21 before sampling the skin replica 21.

  FIG. 6 is an image diagram of an example of the three-dimensional point cloud data 22. The point cloud data 22 represents each point data with X, Y and Z coordinates. The point cloud data 22 represents the uneven state of the skin, and can represent the point cloud 23 as shown in FIG. FIG. 7 is an image diagram of an example of the point group 23 representing the uneven state of the skin.

  When the point cloud data 22 is acquired from the measuring device 2, the simulation device 1 proceeds to step S2 following step S1, and the user removes noise, trims unnecessary data, and sets the magnification value as environmental conditions necessary for the lighting simulation function described later. Set based on requests from Progressing to step S3 following step S2, the simulation apparatus 1 performs the three-dimensional image 24 by polygon data as shown in FIG. 8 reproducing the skin unevenness state according to the point cloud data 22 representing the skin unevenness state and the environmental conditions. Create

  FIG. 8 is an image diagram of an example representing the three-dimensional image 24 using polygon data. The three-dimensional image 24 using polygon data in FIG. 8 is obtained by rendering according to environmental conditions such as point cloud data 22 representing the uneven state of the skin, noise removal, trimming of unnecessary data, and magnification. Observation (rotation) and stereoscopic display by stereo viewing are possible. The simulation apparatus 1 uses the three-dimensional image 24 to realize a viewer function, a data output function, a cross-sectional display / measurement function, and a lighting simulation function, which will be described later.

  FIG. 9 is a screen diagram showing an image of the viewer function. With the viewer function of FIG. 9, the uneven state of the skin can be expressed with an arbitrary size from an arbitrary angle. Further, the data output function can supply polygon data generated from the point cloud data 22 to an optical modeling system capable of reconfiguring the skin replica 21 or a stereoscopic vision system capable of stereoscopic viewing. For example, the stereolithography system can create a skin shape model that is touched by the stereolithography method from polygon data generated from the point cloud data 22. In an optical modeling system, a liquid resin that cures in response to ultraviolet rays is cured and laminated with an ultraviolet laser to create a precise skin shape model. FIG. 10 is a screen diagram showing an image of the cross-section display / measurement function. The cross-section display / measurement function of FIG. 10 can perform distance measurement between two points and horizontal / vertical cross-section measurement.

  However, the viewer function shown in FIG. 9 and the cross-sectional display / measurement function shown in FIG. 10 are suitable for elucidating how the texture of unevenness such as skin texture and pores caused by light affects the appearance of the skin. Not. Therefore, the simulation apparatus 1 according to the present invention realizes a lighting simulation function. Lighting simulation simulates the state of shading (surface reflection change) according to the size of the unevenness, the viewpoint, and the position of the light source.

  Here, the lighting simulation function realized by the simulation apparatus 1 will be described. FIG. 11 is an image diagram illustrating an example of shadow expression by CG (computer graphics). The shadow expression by CG must consider the shadow and the shadow.

  However, a general rendering technique does not consider shadows for speeding up image generation. Here, the rendering technique is a technique for creating a three-dimensional image 24 representing the uneven state of the skin from polygon data generated from the three-dimensional point cloud data 22. Examples of such a general rendering method include a Z buffer method and a scan line method. A general rendering method that does not consider shadows has low reality, and it was not suitable for elucidating how the shadows of skin texture and pores caused by light affect the appearance of the skin. .

  Therefore, in the simulation apparatus 1 according to the present invention, the application of the ray tracing method capable of considering not only the shadow but also the shadow was examined. Here, the ray tracing method is a method of generating a three-dimensional image by back tracking light from a viewpoint toward a light source. As a result, the distributed ray tracing method capable of considering the shadow including the penumbra was applied to the lighting simulation function of the simulation apparatus 1 according to the present invention. Here, the distributed ray tracing method is a method of improving the ray tracing method, generating a three-dimensional image 24 by back tracking light a plurality of times, giving a width from the viewpoint to the light source direction.

  FIG. 12 is an image diagram showing the difference in the appearance of the shadow by the rendering method. Here, an example in which there is a light source in the upper right direction of the indentation is shown. In FIG. 12, the indentation on the left side uses a general rendering method, and only shades are considered. In FIG. 12, the hollow in the middle uses the ray tracing method and takes shadows and shadows into consideration. In FIG. 12, the indentation on the right side uses the distributed ray tracing method, and shadows, shadows, and penumbras are taken into consideration. In FIG. 12, the reality of the right indentation considering shadow, shadow, and penumbra is the highest, and the reality of the left indentation considering shadow alone is the lowest.

  In the simulation apparatus 1 according to the present invention, the amount of calculation is large but the reality of the shadow is large in order to elucidate how the uneven shadow such as skin texture and pores caused by light affects the appearance of the skin. The distributed ray tracing method with the highest performance is applied.

  FIG. 13 is an image diagram illustrating an example of a main screen of the lighting simulation function. In the main screen 100 of FIG. 13, the state of the shadow can be confirmed by rendering processing while switching the positions of the camera and the light. The main screen 100 is configured to include a view window 101, camera / light position information 102, camera information 103, and light information 104.

  The view window 101 displays the rendering result. The camera / light position information 102 visually displays the position of the camera and the light. In the camera / light position information 102, each position is expressed in polar coordinates, and the direction perpendicular to the paper surface is the latitude direction, and the longitude is taken along the circumference of the horizontal direction. A three-dimensional image is placed at the center of this coordinate. The camera information 103 displays the set camera parameters in a table format. The light information 104 displays the set light parameters in a table format.

  The user can set the camera and light positions using the camera / light position information 102, the camera information 103, and the light information 104. FIG. 14 is an enlarged view of an example of camera / light position information. In the camera / light position information 102 in FIG. 14, a number surrounded by a square represents the position of the camera, and a number surrounded by a circle represents the position of the light.

  After setting the camera and light positions, the user performs rendering according to the camera and light positions. Then, the user checks the rendering result corresponding to the positions of the camera and the light in the view window 101.

  In the following, an example of a process for elucidating how the shadow of unevenness such as skin texture and pores caused by light affects the appearance of the skin using the lighting simulation function will be described.

  FIGS. 15 to 23 show transitions of the view window 101 and the camera / light position information 102 when the light position is changed in terms of latitude. For example, FIG. 15 shows an example in which there is a light in the left direction of the skin. FIG. 19 shows an example in which there is light in the upward direction of the skin. FIG. 23 shows an example in which there is a light in the right direction of the skin. In other words, it can also be said that FIGS. 15 to 23 represent transitions when the elevation angle at which light is irradiated is changed stepwise.

  24 to 30 show transitions of the view window 101 and the camera / light position information 102 when the light position is changed in longitude. For example, FIGS. 24 to 30 show examples of changing the position of the light counterclockwise. In other words, it can also be said that FIGS. 24 to 30 represent transitions when the longitude angle of light irradiation is changed stepwise.

  When the position of the light is changed in latitude or longitude, the state of the skin hill bark or texture can be expressed. In particular, when the position of the light is changed in latitude, the state of the skin can be expressed better. In addition, when the position of the light is changed in longitude, the texture state can be expressed better.

  In this way, the user can recognize the degree of unevenness and the feeling of shading, which are the hills and textures of the skin, using FIGS.

  FIG. 31 shows the transition of the rendering result when the position of the light that irradiates the skin with fine texture is changed. Referring to the rendering result of FIG. 31, it can be recognized that the texture has directionality. Therefore, as shown in FIG. 32, the user can select and view a rendering result in which the directionality of the texture is easy to understand by changing the angle of light applied to the skin.

  FIG. 33 shows the transition of the rendering result when the position of the light that irradiates the skin with conspicuous pores is changed. Referring to the rendering result of FIG. 33, it can be seen that there is a difference in how the pores stand out. Therefore, the user can select and view the rendering result that makes the pores conspicuous by changing the angle of light applied to the skin.

  The simulation apparatus 1 according to the present invention can also evaluate the skin replica 21 using the viewer function, data output function, cross-section display / measurement function, and lighting simulation function described above. For example, the parameters for evaluating the skin replica 21 can be classified into the whole skin, the textured part, and the cuticle part. The skin can be classified according to the numerical value of each parameter.

  Parameters relating to the entire skin include depth classification and statistics (number, average value, variance, kurtosis, skewness, etc.) from the reference surface. Parameters related to textured parts are depth distribution, total volume and total perimeter, curvature change, directionality, continuity, and statistics indicating how to distribute these (number, average value, variance, kurtosis, distortion) Degree). Parameters related to the skin region are the surface area distribution, volume, curvature, shape (horizontal, vertical, circularity, perimeter, etc.), and statistics (number, average, variance, Kurtosis, skewness, etc.). Then, by classifying the skin according to the evaluation result of the skin replica 21 and associating the classification with the product information and creating a database, it becomes easy to propose the product to the user.

  In the above description of step S1, the replica method for acquiring the point cloud data 22 obtained by digitizing the skin replica 21 by sampling the skin replica 21 with a laser scanner has been described as an example. However, the present invention is not limited to this method. is not. For example, when the point cloud data 22 representing the uneven state of the skin is acquired by the measuring device 2 using a non-contact three-dimensional measurement method such as a laser method or a light projection method, the point cloud data 22 can be directly acquired from the customer's skin. Therefore, the simulation system according to the present invention is installed in a cosmetics department store such as a department store, and skin counseling can be performed with the uneven state of the skin as a cut.

  The three-dimensional point cloud data acquired by the measuring device 2 is edited and analyzed by the simulation device 1 of the present invention, and the rendering result (polygon image) representing the skin unevenness state and the rendering result (polygon image) representing the skin unevenness state is obtained by the customer. Can be presented. The presented content represents the characteristics of the customer's individual skin and can be used for counseling such as cosmetic effects and selection methods for each skin.

  For example, in the case of skin care, the effect of the cosmetics can be presented to the customer and deepened based on the change in the uneven state such as texture and pores before and after the use of the skin care cosmetics such as lotion, milky lotion and cream. In the case of a foundation, the optimum dosage form suitable for the skin condition such as powdery foundation, liquid foundation, and combination of these and the groundwork should be selected from the above-mentioned parameters (texture, pore size, distribution pattern, etc.). You can also.

  In the present invention, the skin replica 21 is sampled by the laser scanner, and the point cloud data 22 obtained by digitizing the skin replica 21 can be acquired. A skin shape model can be manufactured from the point cloud data 22 obtained by digitizing the skin replica 21. Therefore, in the present invention, the skin replica 21 can be stored digitally, and the uneven state of the skin can be evaluated when necessary.

  In addition, this invention is not limited to said Example, A various deformation | transformation and change are possible within the scope of the present invention.

It is a block diagram of one Example of the simulation system by this invention. It is a hardware block diagram of an example which implement | achieves a simulation apparatus. It is an image figure of an example of a laser scanner. It is a flowchart which shows the process of the simulation method by this invention. It is an image figure of an example of a skin replica. It is an image figure of an example of three-dimensional point cloud data. It is an image figure of an example of the point group showing the uneven | corrugated state of skin. It is an image figure of an example showing a three-dimensional image. It is a screen figure showing the image of a viewer function. It is a screen figure showing the image of a section display / measurement function. It is an image figure of an example showing the shadow expression by CG (computer graphics). It is an image figure showing the difference in the appearance of the shadow by a rendering method. It is an image figure of an example showing the main screen of a lighting simulation function. It is an enlarged view of an example of camera light position information. It shows the transition of the view window and camera light position information when the light position is changed in latitude. It shows the transition of the view window and camera light position information when the light position is changed in latitude. It shows the transition of the view window and camera light position information when the light position is changed in latitude. It shows the transition of the view window and camera light position information when the light position is changed in latitude. It shows the transition of the view window and camera light position information when the light position is changed in latitude. It shows the transition of the view window and camera light position information when the light position is changed in latitude. It shows the transition of the view window and camera light position information when the light position is changed in latitude. It shows the transition of the view window and camera light position information when the light position is changed in latitude. It shows the transition of the view window and camera light position information when the light position is changed in latitude. It shows the transition of the view window and camera light position information when the light position is changed in longitude. It shows the transition of the view window and camera light position information when the light position is changed in longitude. It shows the transition of the view window and camera light position information when the light position is changed in longitude. It shows the transition of the view window and camera light position information when the light position is changed in longitude. It shows the transition of the view window and camera light position information when the light position is changed in longitude. It shows the transition of the view window and camera light position information when the light position is changed in longitude. It shows the transition of the view window and camera light position information when the light position is changed in longitude. The texture represents the transition of the rendering result when the position of the light that irradiates light to fine skin is changed. It is an image figure of an example of the rendering result which is easy to understand the direction of texture. This represents a transition of the rendering result when the position of the light that irradiates the skin with conspicuous pores is changed.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Simulation apparatus 2 Measuring apparatus 21 Skin replica 22 Point cloud data 23 Point cloud 24 Three-dimensional image 100 Main screen 101 View window 102 Camera / light position information 103 Camera information 104 Light information

Claims (6)

A simulation device for evaluating and simulating the uneven state of the skin,
An environmental condition setting means for setting an environmental condition including a viewpoint and a position of a light source according to a request from a user;
Three-dimensional image creation means for creating a three-dimensional image that simulates the evaluation of the uneven state of the skin and the state of the shadow according to the three-dimensional point cloud data representing the uneven state of the skin and the environmental conditions;
I have a,
Expressing the state of the skin hill by changing the position of the light source in latitude, or expressing the texture state by changing the position of the light source in longitude
A simulation apparatus characterized by the above. The simulation apparatus according to claim 1, wherein the three-dimensional image creating unit simulates a state of shadow, shadow, and penumbra. Is connected to a measuring means for measuring a three-dimensional point group data representing the irregularities of the skin, the simulation of claim 1 or 2 wherein wherein obtaining the point cloud data of the three-dimensional from the measuring means apparatus. Wherein with the three-dimensional image, the simulation apparatus of claims 1 to 3 any one claim, characterized by further comprising a presentation means for presenting the environmental conditions to the user. The simulation apparatus according to any one of claims 1 to 4 , wherein the skin is classified according to a state of the skin hill and texture, and product information associated with the classification is presented. A simulation method for evaluating and simulating skin unevenness,
Computer
Setting environmental conditions including the viewpoint and the position of the light source in response to a request from the user;
Creating a three-dimensional image simulating skin unevenness evaluation and shading according to three-dimensional point cloud data representing skin unevenness information and the environmental conditions;
Run
Expressing the state of the skin hill by changing the position of the light source in latitude, or expressing the texture state by changing the position of the light source in longitude
A simulation method characterized by the above.