JP7492932B2 - Molding system and molding method - Google Patents

Description

The present invention relates to a modeling system and a modeling method.

Conventionally, there is known a modeling device (3D printer) that uses an inkjet head to model an object (see, for example, Patent Document 1). In such a modeling device, for example, an object is modeled by layering multiple layers of ink formed by an inkjet head using an additive modeling method. Furthermore, in a modeling device, a modeling operation is usually performed based on object data that indicates the object to be modeled. In this case, the object data can be created, for example, by reading the shape and color of the object to be modeled (object to be modeled) using a device such as a 3D scanner. In this case, the object to be modeled can be considered to be, for example, an object to be expressed by the object.

JP 2015-071282 A

When generating object data by reading the shape and color of an object to be modeled using a 3D scanner or the like, it is usually considered preferable to read the shape and color as accurately as possible. In response to this, the inventors of the present application conducted experiments in which various objects were actually modeled, and found that, depending on the object to be modeled, it may be preferable to generate object data using a method other than simply reading the shape and color accurately. For this reason, it has been desirable to generate object data using a more appropriate method. The present invention aims to provide a modeling system and a modeling method that can solve the above problems.

The inventors of the present application have considered generating object data by reading the shapes and colors of various objects using a 3D scanner or the like, and then creating objects based on the object data. They have found that, for example, when the object to be created is a human, it is difficult to create a desirable object simply by accurately reading the shape and color using a 3D scanner or the like. More specifically, when creating an object that represents a human, it is possible to create the object at a smaller size than an actual human. In this case, even if the shape and color of an actual human (person) are faithfully reproduced, the impression may be significantly different from that of the actual human due to the effect of the change in size. Furthermore, when creating an object that represents a human, it is not necessarily preferable to faithfully reproduce an actual human. For example, it may be desirable to create a model that emphasizes the individuality of the person, or to create a model that improves the appearance.

In response to this, the inventors of the present application conceived of a way to more appropriately model objects representing humans by correcting the data generated by scanning the human, the object to be modeled, with a 3D scanner. Furthermore, through further intensive research, they discovered the characteristics necessary to achieve this effect, leading to the present invention. In order to solve the above problems, the present invention provides a modeling system for modeling a three-dimensional object, comprising a data generation unit that generates model data representing the object to be modeled, and a modeling execution unit that models the object based on the model data generated by the data generation unit, the data generation unit performs a data acquisition process for acquiring object data, which is data generated by scanning a human being, which is an object to be modeled, with a 3D scanner, a data correction process for correcting the object data, and a model data generation process for generating the object data based on the object data after the correction in the data correction process, the object data being data representing at least the shape of at least a part of the human being, including the human's face, and the color of each position on the surface of the shape, and in the data correction process, the data generation unit corrects the object data to change the state of the human's face represented by the object data.

When configured in this manner, for example, it is possible to appropriately correct object data generated by scanning a human body with a 3D scanner in order to change the state of the human face represented by the model. Furthermore, by generating model data based on the corrected object data and executing modeling in the modeling execution unit based on the model data, it is possible to appropriately model a model that reflects the results of the correction. This also makes it possible to more appropriately model, for example, a model showing a human body (person) in a desired state.

In this configuration, the 3D scanner can be considered to be, for example, a reading device that reads the color and shape of at least a part of the object. In this case, the color of the object can be considered to be, for example, the color of the surface of the object. The modeling system may further include a 3D scanner. In addition, with regard to the operation of the data generation unit in the data correction process, changing the state of the human face indicated by the object data can be considered to be, for example, changing the shape and color of at least a part of the face. Changing the state of the human face indicated by the object data can be considered to be, for example, changing the facial expression of the human expressed by the shape and color indicated by the object data. In addition, in this configuration, the modeling execution unit includes, for example, an inkjet head that ejects ink that is a modeling material. In this case, the modeling execution unit models a model by, for example, stacking multiple layers of ink. With this configuration, for example, the modeling execution unit can appropriately perform modeling of the model.

In addition, in the data correction process, the data generation unit changes, for example, the shape indicated by the object data. With this configuration, for example, correction of the object data can be performed appropriately. More specifically, in the data correction process, the data generation unit changes the shape indicated by the object data for a portion corresponding to at least one of the eyes, nose, and mouth in a human face. With this configuration, for example, the state of the human face indicated by the object data can be changed appropriately. More specifically, in the data correction process, the data generation unit changes the shape indicated by the object data for at least a portion of the portion corresponding to at least one of the eyes, nose, and mouth in a human face so that the position of the surface changes in the normal direction that is perpendicular to the surface of the shaped object. With this configuration, for example, the shape indicating the eyes, nose, mouth, etc. in the object data can be changed appropriately. In this case, the operation of changing the shape indicated by the data for a portion corresponding to at least one of the eyes, nose, and mouth in a human face can also be considered as, for example, a correction that changes the shape of a part that constitutes a human face. In addition, in the data correction process, the data generation unit may change the shape indicated by the object data for parts of a human face that correspond to features other than the eyes, nose, and mouth (e.g., ears or eyebrows).

In addition, in the data correction process, the data generation unit may change the color indicated by the object data. In this case, in the data correction process, the data generation unit changes the color indicated by the object data so that at least a part of the color of the human face indicated by the object data changes. With this configuration, for example, the state of the human face indicated by the object data can be changed more appropriately. In this case, as a correction to change the color of at least a part of the human face indicated by the object data, for example, correction of the object data is performed so that the color of the eyes in the human face indicated by the object data changes. As a correction to change the color of at least a part of the human face indicated by the object data, for example, correction of the object data is performed so that the mouth (lips), nose, ears, or skin color (skin color) in the human face indicated by the object data changes. In this case, it is also possible to change the size of a feature (for example, the eyes) in the human face indicated by the object data by changing the color of a part of the face.

In this configuration, the object data may be data in which the color of each position on the surface is set by mapping a texture using a UV coordinate system. In this case, the correction for changing the color indicated by the object data may be performed by, for example, changing the color of the image indicated by the texture. More specifically, in this case, in the data correction process, the data generation unit identifies, for example, a face area that is an area indicating a human face in the image indicated by the texture mapped in the object data. Then, the state of the human face indicated by the object data is changed based on the identified face area. With this configuration, for example, correction of the object data may be performed appropriately. In this case, for example, it is possible to change the color of at least a part of the face area. With this configuration, for example, correction for changing the color indicated by the object data may be performed appropriately. In addition, in the data correction process, the data generation unit may further identify, for example, an eye area that is an area indicating human eyes in the face area, and perform correction of the object data so that the state of the eyes in the human face indicated by the object data is changed. With this configuration, for example, the impression of the human face indicated by the object data may be easily and appropriately changed. In this case, for example, corrections could be made to increase the contrast between the black and white of the eye, or to increase the size of the eyes.

In addition, in the data correction process, the data generation unit performs corrections to the object data, for example, by changing the position to which the eye region corresponds in the UV map, so that the state of the eyes in the human face represented by the object data changes. In this case, the UV map can be considered, for example, as data indicating the correspondence between each position in the UV coordinate system and each position in the texture. By configuring in this way, for example, it is possible to appropriately change the state of the eyes in the human face represented by the object data. Also, in this case, for example, it is possible to change the position to which the eye region corresponds in the UV map without changing the image itself represented by the texture. By configuring in this way, for example, it is possible to change the impression of the eyes more naturally.

In addition, in the data correction process, for example, a correction may be made to change the color of human skin. In this case, in the data correction process, the data generation unit makes a correction to the object data so that, for example, the skin color of the human face represented by the object data changes. In addition, when making the above-mentioned color correction, in the data correction process, the data generation unit may change the image represented by the texture without changing the shape represented by the object data. In such a configuration, for example, by not changing the shape, correction of the object data can be made more easily.

In the data correction process, the data generation unit receives, for example, a correction instruction from the user, which is an instruction indicating the correction to be made to the object data, and corrects the object data based on the correction instruction. With this configuration, for example, it is possible to appropriately perform correction according to the user's intention. The data generation unit may have a display unit that displays a screen to the user. As the display unit, for example, a known image display device such as a monitor can be suitably used. In this case, in the data correction process, the data generation unit receives a correction instruction from the user while, for example, displaying at least a part of the human represented by the object data three-dimensionally on the display unit. With this configuration, for example, it is possible to more appropriately receive the correction instruction. In this case, the three-dimensional display on the display unit can be considered to be, for example, a display that allows the user to recognize the three-dimensional shape of the displayed object. Also, as such a display, for example, a display using a known 3D display technology can be considered.

Furthermore, the display of at least a portion of the human represented by the object data in a three-dimensional manner on the display unit can be considered to be, for example, a display of a prediction of the modeling result of the object to be modeled. In this case, the operation of the data generation unit can be considered to be, for example, an operation of receiving a correction instruction from the user while displaying a prediction of the modeling result. More specifically, in this case, in the data correction process, the data generation unit receives a correction instruction from the user while displaying, on the display unit, at least a portion of the predicted object, which is an object to be modeled when using object data generated based on the corrected object data when the object data is corrected in accordance with the correction instruction. In this configuration, the user can, for example, more appropriately determine the correction instruction for making the desired correction. This also allows, for example, the data generation unit to more appropriately receive the correction instruction.

In addition, in this configuration, the data generation unit may perform correction in a correction mode selected by the user. More specifically, in this case, the data generation unit may use, for example, a plurality of different correction modes selectable by the user. Each of the plurality of correction modes may be associated with, for example, a method of specifying a correction instruction. In this case, the data generation unit may further perform, for example, a correction mode selection process in which an instruction to select one of the plurality of correction modes is received from the user. In addition, in the data correction process, the data generation unit may receive, for example, a correction instruction from the user in a method of specification associated with the correction mode selected in the correction mode selection process, and perform correction of the object data based on the correction instruction. With this configuration, for example, correction of the object data may be appropriately performed in various correction modes.

In this case, it is possible to use multiple types of correction modes with different levels of detail. With this configuration, it is possible to appropriately change the way correction instructions are given, for example, depending on the quality desired by the user. More specifically, in this case, in the correction mode selection process, the data generation unit receives an instruction from the user to select one of multiple types of correction modes, including a predetermined correction mode, which is a correction mode that performs a preset correction without receiving a parameter designation indicating the strength of the correction from the user, and a parameter designation mode, which is a correction mode that performs correction with the strength designated by the parameter by receiving a parameter designation from the user. With this configuration, it is possible to appropriately correct the object data in various correction modes, for example, depending on the quality desired by the user. In this case, the predetermined correction mode can be considered, for example, as a correction mode that performs a simple correction by specifying the content of the correction without using a parameter indicating the strength of the correction. The parameter designation mode can be considered, for example, as a correction mode that performs a more detailed correction by specifying the method of correction more specifically using a parameter indicating the strength of the correction.

As a correction mode, for example, a correction mode that specifies the method of correction in more detail than the parameter specification mode may be used. In this case, it is possible to use a correction mode that allows the user to directly perform an operation to change the shape of the object indicated by the object data, for example by editing polygons. More specifically, in this case, in the correction mode selection process, the data generation unit receives an instruction from the user to select one of multiple types of correction modes that further include, for example, a shape adjustment mode, which is a correction mode that performs correction to change the shape of the object indicated by the object data in response to a user operation. With this configuration, for example, correction of the object data can be more appropriately performed in various correction modes.

As a configuration of the present invention, it is also conceivable to use a molding method or the like having the same characteristics as described above. In this case, for example, the same effects as described above can be obtained. In this case, the molding method can also be considered, for example, as a manufacturing method for a molded object.

The present invention makes it possible to more appropriately model objects that represent, for example, humans.

1A is a diagram showing an example of a modeling system 10 according to an embodiment of the present invention. Fig. 1A shows an example of the configuration of the modeling system 10. Fig. 1B shows an example of the configuration of a main part of a modeling device 12. Fig. 1C shows an example of the configuration of a head unit 102. 2A shows an example of the configuration of a model 50 to be modeled by the modeling device 12. FIG. 2B is a flowchart showing an example of an operation for generating model data in the control PC 14. 10 is a flowchart showing an example of a correction operation performed on scan data in the control PC 14. 11A and 11B are diagrams for explaining the operation of eye adjustment in more detail. 5A and 5B are diagrams for explaining in more detail how to receive a correction instruction, etc. Fig. 5A shows an example of a screen for receiving a selection of a correction mode, and Fig. 5B shows an example of a screen shown to a user when a detailed mode is specified as the correction mode.

Hereinafter, an embodiment of the present invention will be described with reference to the drawings. FIG. 1 shows an example of a modeling system 10 according to an embodiment of the present invention. FIG. 1(a) shows an example of the configuration of the modeling system 10. In this example, the modeling system 10 is a modeling system that models a three-dimensional object, and includes a modeling device 12, a control PC 14, and a 3D scanner 16. The object modeled by the modeling system 10 can be considered to be, for example, a three-dimensional structure.

The modeling device 12 is an example of a modeling execution unit that executes modeling of a model, and models the model in response to the control of the control PC 14. In this example, the modeling device 12 is a full-color modeling device that can model a full-colored object, receives model data that indicates the object to be modeled from the control PC 14, and models the object based on the model data. In this example, the operation of modeling the object in the modeling device 12 is an example of the operation of the modeling execution stage.

The control PC 14 is a computer (host PC) that controls the operation of the modeling device 12, and controls the modeling operation of the modeling device 12 by supplying the modeling data to the modeling device 12. In this example, the control PC 14 generates modeling data indicating a model having a colored surface that can be seen from the outside based on the scan data received from the 3D scanner 16, and supplies the generated data to the modeling device 12. The modeling data can be considered to be, for example, data indicating a model to be modeled in the modeling device 12. The modeling data can also be considered to be, for example, input data to the modeling device 12. In this example, the control PC 14 is an example of a data generation unit. The operation of generating the modeling data in the control PC 14 is an example of the operation of the data generation stage. The scan data received by the control PC 14 from the 3D scanner 16 is an example of object data. In this example, the control PC 14 corrects the scan data based on a user's instruction, and generates the modeling data based on the corrected scan data. The corrections made to the scan data by the control PC 14 will be explained in more detail later.

The 3D scanner 16 is a device that reads the shape and color of a three-dimensional object. As the 3D scanner 16, a known 3D scanner or the like can be suitably used. The 3D scanner 16 can be considered, for example, as a reading device that reads the color and shape of at least a part of the object to be modeled. In this case, the color of the object can be considered, for example, as the color of the surface of the object. In this example, the 3D scanner 16 generates scan data indicating the shape and surface color of at least a part of the three-dimensional object to be read. The scan data can be considered, for example, as data generated by scanning the three-dimensional object with the 3D scanner 16. In the scan data, the shape of the three-dimensional object can be shown, for example, using data indicating the shape in a known format for 3D models. The surface color of the three-dimensional object can be shown, for example, using an image (texture image) indicated by a texture to be attached to the surface of the three-dimensional shape (three-dimensional shape). In the scan data of this example, the three-dimensional shape is shown in a format that allows the texture to be attached to the surface by the UV mapping method. The surface color is shown by attaching a texture to the three-dimensional shape by the UV mapping method. In this case, the scan data can be thought of as data in which the color of each position on the surface is set by mapping a texture using a UV coordinate system, for example.

In this example, the modeling system 10 models a modeled object representing a human being. The 3D scanner 16 reads the human being, who is the object to be modeled, and generates scan data representing the shape and color of the human being. The 3D scanner 16 then supplies the generated scan data to the control PC 14. According to this example, for example, a modeled object representing a human being (e.g., a figurine, etc.) can be appropriately modeled.

In this example, the modeling system 10 is composed of three devices: a modeling device 12, a control PC 14, and a 3D scanner 16. In a modified example of the modeling system 10, the modeling system 10 may further include devices other than these. In a modified example of the modeling system 10, for example, it is also possible to configure the modeling system 10 with two or fewer devices. In this case, for example, it is possible to use a modeling device 12 that also has the function of the control PC 14.

Next, the specific configuration of the modeling device 12 will be described. FIG. 1B shows an example of the configuration of the main parts of the modeling device 12. In this example, the modeling device 12 is a modeling device that models a three-dimensional object 50, and has a head unit 102, a modeling table 104, a scan drive unit 106, and a control unit 110. Except for the points described below, the modeling device 12 may have the same or similar configuration as a known modeling device. More specifically, except for the points described below, the modeling device 12 may have the same or similar characteristics as a known modeling device that performs modeling by ejecting droplets that are the material of the modeled object 50 using an inkjet head. In addition, the modeling device 12 may further include various configurations necessary for, for example, modeling the modeled object 50, in addition to the configuration shown in the figure. In addition, in this example, the modeling device 12 is a modeling device (3D printer) that models a three-dimensional object 50 by additive manufacturing. The additive manufacturing method can be considered, for example, to be a method of forming an object 50 by stacking multiple layers.

The head unit 102 is configured to eject the material of the model 50. In this example, ink is used as the material of the model 50. The ink can be considered to be, for example, a functional liquid. The ink can also be considered to be, for example, a liquid ejected from an inkjet head. In this example, the head unit 102 ejects ink that hardens according to predetermined conditions from multiple inkjet heads as the material of the model 50. Then, by hardening the ink after landing, each layer constituting the model 50 is formed by stacking, and the model is formed by a layered modeling method. In this example, as such ink, ultraviolet curable ink (UV ink) that hardens from a liquid state by irradiation with ultraviolet rays is used. In addition to the material of the model 50, the head unit 102 further ejects the material of the support layer 52. As a result, the head unit 102 forms the support layer 52 around the model 50 as necessary. The support layer 52 can be considered, for example, as a laminated structure that supports at least a portion of the object 50 during modeling. The support layer 52 is formed as necessary during modeling of the object 50, and is removed after modeling is completed.

The modeling table 104 is a platform-like member that supports the object 50 being modeled, and is disposed in a position facing the inkjet head in the head unit 102. The object 50 being modeled and the support layer 52 are placed on the upper surface of the modeling table 104. In this example, the modeling table 104 is configured to be movable in the stacking direction (Z direction in the figure), and is driven by the scan drive unit 106 to move in the stacking direction in accordance with the progress of modeling of the object 50. In this case, the stacking direction can be considered to be, for example, the direction in which the material for modeling is stacked in the additive modeling method. In this example, the stacking direction is perpendicular to the main scanning direction (Y direction in the figure) and sub-scanning direction (X direction in the figure) that are preset in the modeling device 12.

The scan driver 106 is a driver that causes the head unit 102 to perform a scanning operation in which the head unit 102 moves relative to the object 50 being modeled. In this example, the movement relative to the object 50 being modeled can be considered to be, for example, a movement relative to the modeling table 104. Also, causing the head unit 102 to perform a scanning operation can be considered to be causing the inkjet head of the head unit 102 to perform a scanning operation. Also, in this example, the scan driver 106 causes the head unit 102 to perform a main scanning operation (Y scan), a sub-scanning operation (X scan), and a stacking direction scanning operation (Z scan) as scanning operations.

In this case, the main scanning operation can be considered to be, for example, an operation of ejecting ink while moving in the main scanning direction relative to the object 50 being modeled. The sub-scanning operation can be considered to be, for example, an operation of moving relative to the object 50 being modeled in the sub-scanning direction perpendicular to the main scanning direction. The sub-scanning operation can also be considered to be, for example, an operation of moving in the sub-scanning direction relative to the modeling table 104 by a preset feed amount. In this example, the scan driving unit 106 causes the head unit 102 to perform the main scanning operation and the sub-scanning operation, thereby forming an ink layer on the head unit 102. The stacking direction scanning operation can be considered to be, for example, an operation of moving in the stacking direction relative to the object 50 being modeled. The scan driving unit 106 adjusts the relative position of the inkjet head to the object 50 being modeled in the stacking direction by causing the head unit 102 to perform the stacking direction scanning operation in accordance with the progress of the modeling operation.

The control unit 110 includes, for example, the CPU of the modeling device 12, and controls each part of the modeling device 12 to control the operation of modeling the object 50. In this example, the control unit 110 generates slice data, which is data showing a cross section of the object 50 to be modeled, based on the object data received from the control PC 14. Then, in the operation of forming each ink layer that constitutes the object 50, the control unit 110 controls the operation of each inkjet head in the head unit 102 based on the slice data, thereby causing each inkjet head to eject the ink used to model the object. According to this example, for example, the modeling of the object 50 can be performed appropriately.

Next, the configuration of the head unit 102 in the modeling device 12 will be described in more detail. FIG. 1C shows an example of the configuration of the head unit 102. In this example, the head unit 102 has a plurality of inkjet heads 202, a plurality of ultraviolet light sources 204, and a flattening roller 206. The inkjet heads 202 are inkjet head 202s, inkjet head 202w, inkjet head 202y, inkjet head 202m, inkjet head 202c, inkjet head 202k, and inkjet head 202t, as distinguished by the letters s to t in the figure. These inkjet heads 202 are aligned in the main scanning direction with their positions in the sub-scanning direction aligned. Each inkjet head 202 has a nozzle row on the surface facing the modeling table 104, in which a plurality of nozzles are aligned in a predetermined nozzle row direction. In this example, the nozzle row direction is parallel to the sub-scanning direction.

Of these inkjet heads 202, inkjet head 202s is an inkjet head that ejects the material of support layer 52. For example, a known material for support layers can be suitably used as the material of support layer 52. Inkjet head 202w is an inkjet head that ejects white (W color) ink. In this example, white ink is an example of a light-reflective ink, and is used, for example, when forming a region (light-reflecting region) that has the property of reflecting light in the model 50. This light-reflecting region reflects light incident from outside the model 50, for example, when coloring the surface of model 50 in full color expression. The full color expression can be considered, for example, as color expression performed by a possible combination of subtractive color mixing using process color inks.

Inkjet head 202y, inkjet head 202m, inkjet head 202c, and inkjet head 202k (hereinafter referred to as inkjet heads 202y-k) are inkjet heads for coloring used when forming a colored object 50. More specifically, inkjet head 202y ejects yellow (Y) ink. Inkjet head 202m ejects magenta (M) ink. Inkjet head 202c ejects cyan (C) ink. Inkjet head 202k ejects black (K) ink. In this example, each of the colors YMCK is an example of a process color. Inkjet head 202t is an inkjet head that ejects clear ink. The clear ink can be considered to be, for example, an ink that is colorless and transparent (T) to visible light. The clear ink can also be considered to be, for example, an ink to which no coloring material is intentionally added.

The multiple ultraviolet light sources 204 are light sources (UV light sources) for curing ink, and generate ultraviolet light that cures ultraviolet curable ink. In this example, the multiple ultraviolet light sources 204 are arranged at one end side and the other end side of the head unit 102 in the main scanning direction, sandwiching the row of inkjet heads 202 between them. For example, a UV LED (ultraviolet LED) or the like can be suitably used as the ultraviolet light source 204. It is also possible to use a metal halide lamp or a mercury lamp as the ultraviolet light source 204. The flattening roller 206 is a flattening means for flattening the ink layer formed during the modeling of the model 50. The flattening roller 206 flattens the ink layer by contacting the surface of the ink layer during, for example, a main scanning operation and removing a portion of the ink before curing. By using the head unit 102 configured as described above, for example, the ink layer constituting the model 50 can be appropriately formed. Furthermore, by forming multiple layers of ink one on top of the other, it is possible to appropriately form the model 50, for example.

The specific configuration of the head unit 102 is not limited to the configuration described above, and can be modified in various ways. For example, the head unit 102 may further include inkjet heads for colors other than those described above as inkjet heads for coloring. The arrangement of the multiple inkjet heads in the head unit 102 can also be modified in various ways. For example, some inkjet heads may be shifted in position in the sub-scanning direction from the other inkjet heads.

Next, the configuration of the object 50 formed by the modeling device 12 of this example and the operation of generating the object data to be supplied to the modeling device 12 will be described in more detail. FIG. 2 is a diagram that further describes the configuration of the object 50 and the operation of generating the object data. FIG. 2(a) is a diagram showing an example of the configuration of the object 50 formed by the modeling device 12, and shows an example of the configuration of the X-Y cross section, which is a cross section of the object 50 perpendicular to the stacking direction (Z direction). In this case, the Z-X cross section and Z-Y cross section of the object 50 perpendicular to the Y direction and Z direction also have the same configuration.

As explained above, in this example, the modeling device 12 (see FIG. 1) uses the inkjet heads 202y-k (see FIG. 1) and the like to form a colored object 50. In this case, the modeling device 12 forms a model 50 with at least a colored surface as the object 50. The coloring of the surface of the object 50 can be considered to mean, for example, that at least a portion of the area of the object 50 where the color can be seen from the outside is colored. In this case, the modeling device 12 forms a model 50 that includes a light reflecting area 152 and a colored area 154, as shown in the figure. If necessary, a support layer 52 (see FIG. 1) is formed around the object 50, etc.

The light reflecting region 152 is a light reflecting region for reflecting light incident from the outside of the model 50 through the colored region 154, etc. In this example, the modeling device 12 forms the light reflecting region 152 inside the model 50 using white ink ejected from the inkjet head 202w (see FIG. 1). In this example, the modeling device 12 also forms the light reflecting region 152 that also serves as the internal region. In this case, the internal region can be considered, for example, as a region that constitutes the interior of the model 50. In a modified example of the configuration of the model 50, the internal region may be formed as a region separate from the light reflecting region 152. In this case, the modeling device 12 forms the internal region using, for example, any ink other than the material of the support layer 52. Also, the light reflecting region 152 is formed around the internal region.

The colored region 154 is an area that is colored by coloring inks ejected from the inkjet heads 202y-k. In this example, the modeling device 12 forms the colored region 154 around (outside) the light reflecting region 152 using the coloring inks ejected from the inkjet heads 202y-k and the clear ink ejected from the inkjet head 202t (see FIG. 1). In this case, the modeling device 12 expresses various colors by, for example, adjusting the amount of coloring ink ejected at each position. Also, clear ink is used to compensate for changes in the amount of coloring ink that occur due to differences in color. With this configuration, for example, each position of the colored region 154 can be appropriately colored with a desired color.

As described above, in this example, the modeling device 12 models the object 50 based on the object data received from the control PC 14 (see FIG. 1). In this case, the control PC 14 generates the object data based on the scan data received from the 3D scanner 16 (see FIG. 1) by the operation of the flowchart shown in FIG. 2(b).

2B is a flowchart showing an example of the operation of generating object data in the control PC 14. In the operation of generating object data, the control PC 14 first acquires the scan data by receiving the scan data from the 3D scanner 16 (S102). The operation of the control PC 14 in step S102 is an example of the operation of the data acquisition process. As described above, in this example, the control PC 14 corrects the scan data based on the user's instructions. In this case, the user can be considered to be, for example, an operator who operates the control PC 14. Depending on the configuration of the modeling system 10, it is also possible that the person who is the target of reading with the 3D scanner 16 operates the control PC 14. In this case, the user of the control PC 14 can be considered to be the same as the person who is the target of reading with the 3D scanner 16.

In addition, in the operation of correcting the scan data, the control PC 14 receives an instruction from the user to select a correction mode (S104). In this case, the control PC 14 presents the user with a number of different correction modes prepared in advance, for example, and receives an instruction from the user to select one of the multiple correction modes. The operation of the control PC 14 in step S104 is an example of the operation of the correction mode selection process. Examples of the correction modes used in this example and the operation of selecting a correction mode will be described in more detail later.

After the correction mode is selected, the control PC 14 corrects the scan data with an operation corresponding to the correction mode selected by the user (S106). The operation of the control PC 14 in step S106 is an example of the operation of a data correction process. In this example, the control PC 14 corrects the scan data so as to change the impression of the human face shown in the scan data. More specifically, such corrections may include, for example, a correction to change the skin color (skin color) or a correction to change the size of the eyes. The operation of correcting the scan data in this example will be described in more detail later.

After the scan data has been corrected, object data is generated based on the corrected scan data (S108). The operation of the control PC 14 in step S108 is an example of the operation of the object data generation process. As described above, in this example, the control PC 14 supplies the generated object data to the modeling device 12, causing the modeling device 12 to perform a modeling operation. In this case, the object data can also be considered as, for example, data to be supplied to the modeling device 12.

In addition, in step S108 in this example, the control PC 14 generates the object data by, for example, changing the format to match the format of the input data to the modeling device 12. Depending on the formats of the scan data and the object data, the corrected scan data may be used as the object data as is. In this case, the operation of correcting the scan data in step S106 may be considered to combine the operation of the data correction process with the operation of the object data generation process. In addition, in a modified example of the operation of the control PC 14, for example, the change in format to match the format of the input data to the modeling device 12 may be performed when correcting the scan data. In this case, for example, after changing the format to match the format of the input data to the modeling device 12, a correction may be performed to change the impression of the human face shown by the scan data.

According to this example, for example, the scan data can be appropriately corrected. In addition, the object data can be appropriately generated based on the corrected scan data. Furthermore, by supplying the object data generated in the control PC 14 to the modeling device 12, the modeling device 12 can be caused to appropriately perform modeling of the object.

Next, the operation of correcting the scan data in the modeling device 12 will be described in more detail. In relation to this, the reason for correcting the scan data in this example will be described first. As explained above, in the modeling system 10 of this example, the 3D scanner 16 reads the shape and color of a human being to generate scan data. Then, the control PC 14 generates object data based on the scan data, and the modeling device 12 models an object (e.g., a human figure) representing the human being that was the subject of reading by the 3D scanner 16 based on the object data.

More specifically, in this case, for example, a 3D scanner 16 large enough to fit the entire human body may be used to scan the entire human body. When generating scan data in this manner, for example, the large size of the object to be scanned may cause differences in the way the light hits the human body depending on the position of the object to be scanned. In addition, for example, it is possible that shadow areas may occur due to the influence of ambient light. Due to these influences, for example, the skin color may become darker in the scan results, and the contrast between the pupil and the white of the eye may decrease. In this case, for example, if the scan data generated by the 3D scanner 16 is used as is, the human object to be modeled by the modeling device 12 may have dull skin, blurred eyes, or black, crushed eyes. In contrast, the impression of the skin and eyes is particularly important in objects representing humans. Therefore, if dull skin, blurred or crushed eyes, etc. occur, it may be difficult to model an object with the desired finish. Additionally, in the case of human figures, if the skin becomes dull or the eyes become blurred or crushed, the value may decrease significantly.

When creating a model that represents a human, it is conceivable to create the model at a smaller size than an actual human. In this case, the reduced size can make it particularly easy for problems such as eyes becoming crushed. In addition, in this case, the change in size can cause the impression to be significantly different from that of an actual human, even if the shape and color of an actual human (person) are faithfully reproduced. Furthermore, when creating a model that represents a human, it is not necessarily preferable to faithfully reproduce an actual human; for example, it may be desirable to create a model that emphasizes the individuality of the person, or to create a model that improves the visual impression.

In response to this, as described above, in this example, the control PC 14 performs corrections on the scan data. For example, this correction is performed so that the state of the object to be modeled by the modeling device 12 approaches the desired finish. More specifically, in this example, the 3D scanner 16 generates scan data showing at least a portion including the face of the human being to be read. In this case, the scan data can be considered to be, for example, data showing at least the shape of at least a part of the human being including the face and the color of each position on the surface of the shape. In addition, the control PC 14 corrects the scan data to, for example, change the state of the human face shown by the scan data. In this case, changing the state of the human face shown by the scan data can be considered to, for example, change the shape or color of at least a part of the face. In addition, changing the state of the human face shown by the scan data can be considered to, for example, change the human facial expression expressed by the shape and color shown by the scan data. More specifically, in this example, the control PC 14 corrects the scan data to, for example, change the skin color and eye state of the human face to give the impression of a clean skin color and wide-eyed eyes. In this case, the control PC 14 corrects the scan data, for example, by performing the operations in the flowchart shown in FIG. 3.

Figure 3 is a flowchart showing an example of the operation of correction performed on scan data by the control PC 14. In this example, when performing correction on scan data, the control PC 14 first identifies a portion of the scan data that corresponds to a human face based on the 3D model indicated by the scan data (S202). In this case, the 3D model indicated by the scan data can be considered, for example, as a three-dimensional model configured with the shape and color indicated by the scan data. The operation of the control PC 14 in step S202 can also be considered, for example, as an operation of automatically recognizing the face of the 3D model.

In this example, the control PC 14 further identifies a face region (face area) that is a region showing a human face in an image (texture image) shown by a texture that shows the surface color of the three-dimensional shape shown by the scan data based on the identification result in step S202 (S204). More specifically, as described above, in the scan data of this example, the surface color is shown by attaching a texture to the three-dimensional shape using the UV map method. In this case, in step S204, the control PC 14 identifies (obtains) the face region in the texture image based on the UV map of the face part identified in step S202. In this example, the UV map can be considered, for example, as data showing the correspondence between each position in the UV coordinate system and each position in the texture. The UV map can also be considered, for example, as data specifying how to attach a texture to a three-dimensional shape.

In this example, the control PC 14 performs corrections to change the skin color and eye condition of a human face, for example, based on the user's instructions. More specifically, in the correction operation shown in FIG. 3, the control PC 14 performs skin beautification adjustment (S206), which is a correction to change the appearance of the skin on the face, and eye adjustment (S208), which is a correction to change the impression of the eyes. In this case, the control PC 14 performs, for example, a process to brighten (increase) the brightness of the skin color (whitening process) and adjust the skin color as the skin beautification adjustment. In addition, for example, the control PC 14 performs a process to increase (increase) the contrast between the pupil and the white of the eye and a process to increase the size of the eyes (eye size up) as the eye adjustment. In this case, the size of the eyes can be increased slightly, for example, to give the impression of wide eyes.

More specifically, for example, in the operation of performing eye adjustment, the control PC 14 identifies an eye region, which is a region showing human eyes, in the face region based on a 3D model shown by the scan data. The operation of identifying the eye region can be considered, for example, as an operation of automatically recognizing the position of the eyes based on a 3D model. Then, for example, as described above, the scan data is corrected so that the state of the eyes in the human face shown by the scan data changes. In addition, in the correction for increasing the size of the eyes, the control PC 14 increases the size of the eyes, for example, by changing the position to which the eye region corresponds in the UV map. In this case, it is considered that the correction for increasing the size of the eyes is performed, for example, by changing the position to which the eye region corresponds in the UV map without changing the texture image itself. With this configuration, for example, it is possible to increase the size of the eyes with a more natural impression. In addition, in the eye adjustment, for example, it is possible to correct the scan data so that the color of the pupil changes. In this case, it is considered that the correction for changing the color of the pupil is performed, for example, by changing the color of the pupil part in the texture image.

According to this example, for example, it is possible to appropriately perform corrections on the scan data to change the state of the human face represented by the model. This also makes it possible to appropriately change, for example, the impression of the person shown in the corrected scan data. Furthermore, by generating model data based on the corrected scan data and executing modeling in the modeling device 12 (see FIG. 1) based on the model data, for example, it is possible to appropriately model a model that reflects the results of the correction. This also makes it possible to appropriately model a model that gives a better impression than when a person is reproduced with high accuracy using the scan data acquired by the 3D scanner 16 as is, or a model that shows a person in a desired state. As can be understood from the above explanation, according to this example, for example, by correcting the scan data acquired by the 3D scanner 16, it is possible to change the state of the final model while retaining the features of the person who was the subject of the scan. This also makes it possible to appropriately model a model that shows a person in a desired state without changing the basic atmosphere, etc. of the person who was the subject of the scan.

Next, the eye adjustment operation performed by the control PC 14 will be explained in more detail. FIG. 4 is a diagram that explains the eye adjustment operation in more detail. The diagram shown in the upper part of the figure as the state before processing shows an example of a 3D model indicated by the scan data before correction is performed by the control PC 14. This 3D model can be thought of as, for example, a 3D model indicated by the scan data acquired by the 3D scanner 16.

The diagrams in the middle of the figure showing the pre- and post-correction states show examples of texture images before eye adjustment is performed by the control PC 14 (pre-correction) and after eye adjustment is performed (post-correction). In the figure, the thin broken lines indicate the three-dimensional shape to which the texture is applied using the UV map method. More specifically, the scan data in this example shows the shape of the target object using polygons. In this case, the thin broken lines in the figure can be considered to indicate the state of the polygons at each position of a portion of the face area.

As explained above, in eye adjustment, the control PC 14 recognizes the position of the eyes based on the 3D model indicated by the scan data. In this case, for example, it is conceivable to recognize the position of the eyes based on the 3D model indicated by the scan data before correction is performed. It is also conceivable that the recognition of the eye position is performed based on the scan data at the time of performing the eye adjustment. For example, as explained above using FIG. 3, when eye adjustment is performed after skin beautification adjustment, it is conceivable that the recognition of the eye position is performed based on the 3D model indicated by the scan data after skin beautification adjustment.

As explained above, in eye adjustment, the control PC 14 performs, for example, processing to increase the contrast between the pupil and white of the eye, processing to increase the size of the eye, etc. Furthermore, by such correction, the control PC 14 changes the texture image before correction, for example, as shown in the figure, to the texture image after correction. In this case, the 3D model represented by the corrected scan data can be considered to be, for example, as shown in the figure as the post-processing state in the lower part of the figure. According to this example, for example, it is possible to appropriately correct the scan data so that the eyes appear wide open (wide-eyed processing).

Here, as explained above, in this example, the control PC 14 performs skin adjustment in addition to eye adjustment as a correction to the scan data. The skin adjustment and eye adjustment can be performed, for example, by changing only the color without changing the shape of the 3D model. In this case, at least a part of the correction performed in the skin adjustment and eye adjustment can be considered as an example of a correction that changes the color of at least a part of the face area. At least a part of the correction performed in the skin adjustment and eye adjustment can be considered as a correction that changes the color indicated by the scan data so that the color of at least a part of the human face indicated by the scan data changes. As can be understood from the above explanation, in this example, the correction that changes the color, for example, in the skin adjustment, is performed by changing the color of the texture image. In this case, the control PC 14 changes the texture image without changing the shape indicated by the scan data. More specifically, in the skin beautification process, the control PC 14 changes the image indicated by the texture, for example, by changing the skin color in the face area. In addition, in eye adjustment, the control PC 14 may change the texture image, for example, by performing a correction to change the contrast between the white and black of the eye. When configured in this way, for example, the shape shown in the scan data is not changed, making it easier to correct the scan data. This also makes it possible to easily and appropriately change the impression of a human face shown in the scan data, for example.

In addition, in the correction of the scan data, for example, not only the texture image but also the shape indicated by the scan data may be changed. In this case, in the operation of correcting the scan data, the control PC 14 changes the shape indicated by the scan data. Even in this configuration, for example, the correction of the scan data can be appropriately performed. More specifically, in this case, for example, in the operation of adjusting the eyes, it is possible to change the shape indicated by the scan data in accordance with the change in the size of the eyes. In this case, it is possible to change the position of the fine unevenness corresponding to the upper and lower eyelids that form the edge of the eye in accordance with the change in the size of the eyes. In this case, for example, in the eye adjustment, the control PC 14 changes the position to which the eye region is associated in the UV map, and changes the position of the unevenness corresponding to the upper and lower eyelids in accordance with the change in position. With this configuration, for example, the impression of the face indicated by the scan data can be changed more naturally and appropriately.

In the above, the corrections made to the scan data were mainly described with regard to the operation of making corrections to the impression of skin color and eyes. However, it is also possible to make corrections to the scan data other than those mentioned above. In this case, for example, it is possible to make corrections to change the color or shape of various parts that make up a human face. More specifically, parts that make up a human face can include, in addition to the eyes, the nose, mouth, ears, eyebrows, etc. In this case, the control PC 14 makes a correction to change the color of at least a part of the human face shown in the scan data, for example, by correcting the scan data so that the color of at least a part of these parts changes.

It is also possible to carry out corrections to change the shapes indicated by the scan data for various features that make up the face. In this case, it is particularly possible to change the shapes of the eyes, nose, and mouth among the various features. More specifically, in this case, the control PC 14 changes the shapes indicated by the scan data for parts corresponding to at least one of the eyes, nose, and mouth in a human face. With this configuration, for example, it is possible to appropriately change the state of the human face indicated by the scan data. Furthermore, more specifically, in this case, the control PC 14 changes the shapes indicated by the scan data for at least a part of the parts corresponding to at least one of the eyes, nose, and mouth in a human face, so that the position of the surface changes in the normal direction, which is a direction perpendicular to the surface of the shaped object. The change in the position of the surface in the normal direction can be considered, for example, to change the height of the convex part or the depth of the concave part on the surface of the shaped object. With this configuration, for example, it is possible to appropriately change the shapes indicating the eyes, nose, mouth, etc. in the scan data. Also, this makes it possible to appropriately change the state of the human face indicated by the scan data.

Next, the method of receiving correction instructions from the user and the correction modes will be described in more detail. As described above, in this example, the control PC 14 corrects the scan data based on the user's instructions. More specifically, in this example, the control PC 14 receives a correction instruction from the user, which is an instruction indicating the correction to be made to the scan data, and corrects the scan data based on the correction instruction. Furthermore, when performing the correction, the control PC 14 receives an instruction from the user to select a correction mode. Furthermore, in this example, the control PC 14 has a display unit that displays a screen to the user. As the display unit, for example, a known image display device such as a monitor can be suitably used. Then, the control PC 14 receives instructions from the user using, for example, the screen display shown in FIG. 5.

Figure 5 is a diagram that provides a more detailed explanation of how to receive correction instructions. Figure 5(a) shows an example of a screen that receives the selection of a correction mode. Figure 5(b) shows an example of a screen that is shown to the user when the detailed mode is specified as the correction mode.

As described above, in this example, the control PC 14 receives an instruction from the user to select one of the multiple correction modes. The control PC 14 then receives a correction instruction from the user in a manner of designation associated with the correction mode selected by the user, and performs correction on the scan data based on the correction instruction. With this configuration, for example, it is possible to appropriately correct the scan data in various correction modes. This also makes it possible to appropriately perform correction according to the user's intention, for example. In this case, it is possible to associate each of the multiple correction modes with a manner of designation of the correction instruction. In this example, the control PC 14 uses a simple mode, a detailed mode, and a data editing mode as the multiple correction modes. In this case, the control PC 14 displays a selection means corresponding to each correction mode, such as buttons with the characters simple, detailed, and data editing written in FIG. 5(a), and receives an instruction to select a correction mode by the user. In this case, the control PC 14 further receives a correction instruction from the user in a manner of designation associated with the correction mode to be selected.

The multiple types of correction modes used in this example are an example of multiple types of correction modes with different levels of detail in the instructions. By using these multiple types of correction modes, it is possible to appropriately change the way correction instructions are given, for example, depending on the quality desired by the user. In this example, the simple mode is an example of a predetermined correction mode. The predetermined correction mode can be considered, for example, as a correction mode in which a preset correction is performed without receiving a parameter indicating the strength of the correction from the user. Also, the simple mode can be considered, for example, as a correction mode in which a simple correction is performed by specifying the content of the correction without using a parameter indicating the strength of the correction.

In this example, the easy mode is a correction mode that performs correction by specifying an objective, such as making the eyes look brighter or making the skin look more beautiful (beautiful skin). When the easy mode is selected by the user as the correction mode, the control PC 14 displays a selection means, such as a button, indicating the correction objective, for example, as shown in FIG. 5(a) as "bright eyes" and "beautiful skin," and further accepts the selection of the correction objective from the user. Then, based on the correction objective selected by the user, the scan data is corrected by performing eye adjustment, skin adjustment, etc., according to automatically set parameters, for example. By using such an easy mode, for example, it is possible to appropriately correct the scan data without placing a burden on the user.

In this example, the detailed mode is an example of a parameter specification mode. The parameter specification mode can be considered, for example, as a correction mode in which correction is performed with a strength specified by a parameter by accepting a parameter specification from the user. The detailed mode can also be considered, for example, as a correction mode in which correction is performed more precisely than in the simple mode by specifying a correction method using a parameter indicating the strength of correction. When the detailed mode is selected by the user as the correction mode, the control PC 14 accepts from the user a parameter specification indicating the strength of correction by specifying a screen shown in FIG. 5(b), for example. More specifically, in the illustrated case, the control PC 14 accepts from the user a parameter specification for an eye widening degree indicating the degree to which eyes are widened in eye adjustment, a skin beauty degree indicating the degree of adjustment performed to enhance a skin beauty feeling in skin adjustment, and the like. In this case, the control PC 14 performs eye adjustment, skin beauty adjustment, and the like based on the specified parameters to correct the scan data. By using such a detailed mode, for example, correction of the scan data according to the user's wishes can be more appropriately performed.

In this example, the data editing mode is an example of a shape adjustment mode. The shape adjustment mode can be considered, for example, as a correction mode in which a correction is made to change the shape indicated by the scan data in response to a user operation. In this case, changing the shape in response to a user operation can be considered, for example, as directly changing the shape by editing the shape of a polygon indicating the shape in the scan data. In this case, the data editing mode can be considered, for example, as a correction mode in which the user directly performs an operation to change the shape indicated by the scan data by editing a polygon. In addition, the data editing mode can be considered, for example, as a correction mode in which the method of correction is specified in more detail than in the parameter specification mode. In the data editing mode, the user may further edit the texture image in the scan data, not limited to the shape. In the data editing mode, the user may further perform adjustments to change the way the texture is applied to the shape indicated by the scan data.

When the data editing mode is selected by the user as the correction mode, the control PC 14 displays to the user a screen that allows the user to edit the shape of the scan data (e.g., edit polygons) or edit texture images, and allows the user to perform operations to correct the scan data. By using such a data editing mode, for example, detailed and specific corrections can be appropriately made to the scan data as needed. In addition, by using multiple types of correction modes as described above, it is possible to appropriately correct the scan data in various correction modes depending on, for example, the quality desired by the user.

Here, as can be understood from the above explanation, among the multiple types of correction modes, the simple mode and the detailed mode can be considered as correction modes that allow even users who do not have detailed knowledge about the modeling device 12 (see FIG. 1) to specify the correction method relatively easily. In contrast, the data editing mode can be considered as a correction mode that requires a certain level of knowledge about the modeling device 12. Therefore, the data editing mode can be used as a correction mode that can be selected only by some users who have certain knowledge. More specifically, for example, the simple mode and the detailed mode can be correction modes that can be used by general users such as consumers, and the data editing mode can be used only by specific users such as operators of the modeling system 10 (see FIG. 1). In this case, the general user can be, for example, a purchaser of a model to be modeled by the modeling device 12. In addition, the general user can be, for example, a person to be scanned by the 3D scanner 16 (see FIG. 1). Furthermore, specific users who can use the data editing mode can be, for example, sellers who sell objects created by the modeling device 12 and their assistants. Specific users can also be considered, for example, operators who use the data editing mode. Corrections in the data editing mode can also be performed together with corrections in the simple mode or detailed mode. In this case, for example, corrections in the data editing mode can be used to fine-tune the results of corrections made in the simple mode or detailed mode.

As described above, in this example, the scanned data is corrected to bring the finished product closer to the user's desired finish. However, even in this case, if the correction instructions are inappropriate, the product cannot be properly molded with the desired finish. Furthermore, when molding an object using the molding device 12, a large amount of ink is usually consumed. Furthermore, the molding operation may take a long time, from several hours to several days or more. Therefore, if molding is performed with inappropriate correction instructions, a lot of cost and time will be wasted.

Therefore, it is preferable that the control PC 14 receives a correction instruction from the user while displaying at least a part of the human represented by the scan data three-dimensionally on the display unit. In this case, the display of at least a part of the human represented by the scan data three-dimensionally on the display unit can be considered to be, for example, a prediction of the modeling result of the object to be modeled. Also, the display of the object three-dimensionally on the display unit can be considered to be, for example, a display that allows the user to recognize the three-dimensional shape of the displayed object. Also, such a display can be, for example, a display using a known 3D display technology. For the three-dimensional display on the display unit, it is preferable, for example, to perform the display in a state in which the orientation of the object to be displayed can be changed according to the user's instructions. Also, it is possible to display at least a part corresponding to the face as a part of the object. Also, in this case, for example, the scale of the display may be different, and the entire object and the part corresponding to the face may be displayed on the display unit. Also, the display on the display unit can be considered, for example, as a 3D preview display of the modeling result. Also, it is preferable to perform the display of the object on the display unit in a state in which it can be enlarged and reduced according to the user's instructions.

In addition, the control PC 14 may receive the correction instruction while showing the user the predicted result of the object obtained when the scan data is corrected according to the received correction instruction. In this case, the control PC 14 receives the correction instruction from the user while displaying, on the display unit, at least a part of the predicted object, which is the object to be formed when using the object data generated based on the corrected scan data when the scan data is corrected according to the correction instruction. The corrected scan data when the scan data is corrected according to the correction instruction can be considered to be, for example, the scan data when the correction is performed according to the provisional correction instruction at that time. In this case, the user determines the correction instruction to be finally specified, for example, based on the state of the predicted object displayed on the display unit. In this configuration, the user can, for example, appropriately determine the correction instruction for performing the desired correction. This also allows the control PC 14 to receive the correction instruction more appropriately.

The present invention can be suitably used in, for example, modeling systems.

10: Modeling system, 12: Modeling device, 14: Control PC, 16: 3D scanner, 50: Modeled object, 52: Support layer, 102: Head unit, 104: Modeling table, 106: Scanning drive unit, 110: Control unit, 152: Light reflection area, 154: Coloring area, 202: Inkjet head, 204: Ultraviolet light source, 206: Flattening roller

Claims (17)

A modeling system for modeling a three-dimensional object, comprising:
a data generation unit that generates object data representing the object to be modeled;
a modeling execution unit that performs modeling of the object based on the model data generated by the data generation unit,
The data generation unit
A data acquisition process for acquiring object data, which is data generated by scanning a human being, which is the object of modeling, with a 3D scanner;
A data correction process for correcting the object data;
a data generation process for generating the object data based on the object data corrected in the data correction process;
the target object data is data indicating at least a shape of at least a part of the human, including a face of the human, and a color of each position on a surface of the shape;
A modeling system characterized in that, in the data correction process, the data generation unit changes the state of the human face represented by the object data by correcting the object data. The modeling system according to claim 1, characterized in that, in the data correction process, the data generation unit changes the shape indicated by the object data. The modeling system according to claim 2, characterized in that in the data correction process, the data generation unit changes the shape indicated by the object data for parts of the human face that correspond to at least one of the eyes, nose, and mouth. The modeling system according to claim 3, characterized in that in the data correction process, the data generation unit changes the shape indicated by the object data so that the position of the surface of at least a part of the portion corresponding to at least one of the eyes, nose, and mouth of the human face changes in a normal direction that is perpendicular to the surface of the model. The modeling system according to any one of claims 1 to 4, characterized in that in the data correction process, the data generation unit changes the color indicated by the object data so that the color of at least a part of the human face indicated by the object data changes. The modeling system according to any one of claims 1 to 5, characterized in that in the data correction process, the data generation unit receives a correction instruction from a user, which is an instruction indicating a correction to be made to the object data, and corrects the object data based on the correction instruction. the data generation unit has a display unit that displays a screen to the user,
The modeling system according to claim 6, wherein in the data correction process, the data generation unit receives the correction instruction from the user while three-dimensionally displaying at least a portion of the human represented by the object data on the display unit. The modeling system according to claim 7, characterized in that in the data correction process, the data generation unit receives the correction instruction from the user while displaying on the display unit at least a portion of a predicted object, which is the object to be modeled when using the object data generated based on the corrected object data when the object data is corrected in accordance with the correction instruction. The data generation unit further performs a correction mode selection process of receiving an instruction from the user to select one of a plurality of different correction modes;
each of the plurality of types of correction modes is associated with a manner of designating the correction instruction;
A molding system as described in any one of claims 6 to 8, characterized in that in the data correction process, the data generation unit receives the correction instruction from the user in a specified manner corresponding to the correction mode selected in the correction mode selection process, and performs correction on the object data based on the correction instruction. In the correction mode selection process, the data generation unit
a predetermined correction mode in which a preset correction is performed without receiving a parameter indicating the strength of the correction from the user;
The molding system described in claim 9, characterized in that it receives an instruction from the user to select one of the multiple types of correction modes, including a parameter designation mode, which is a correction mode that accepts the designation of the parameter from the user and performs correction at a strength specified by the parameter. In the correction mode selection process, the data generation unit
The molding system described in claim 10, characterized in that an instruction is received from the user to select one of the multiple correction modes, which further includes a shape adjustment mode, which is a correction mode that performs correction to change the shape of the object indicated by the object data in accordance with the user's operation. the object data is data in which a color is set at each position on the surface by mapping a texture using a UV coordinate system;
A modeling system as described in any one of claims 1 to 11, characterized in that in the data correction process, the data generation unit identifies a face area, which is an area indicating the human face, in an image indicated by the texture mapped in the object data, and changes the state of the human face indicated by the object data based on the identified face area. The modeling system according to claim 12, characterized in that in the data correction process, the data generation unit further identifies an eye region within the face region that is an area that represents the human's eyes, and performs corrections to the object data so that the state of the eyes in the human face represented by the object data changes. The modeling system according to claim 13, characterized in that in the data correction process, the data generation unit performs corrections to the object data so that the state of the eyes in the human face represented by the object data changes by changing the position to which the eye area corresponds in a UV map that indicates the correspondence between each position in the UV coordinate system and each position in the texture. The modeling system according to any one of claims 12 to 14, characterized in that in the data correction process, the data generation unit performs corrections on the object data so that the skin color of the human face represented by the object data is changed. The modeling system according to any one of claims 1 to 15, characterized in that the modeling execution unit includes an inkjet head that ejects ink that is a modeling material, and the modeled object is formed by stacking multiple layers of the ink. A method for forming a three-dimensional object, comprising the steps of:
a data generation step of generating object data which is data representing the object to be modeled;
a modeling execution step of modeling the object based on the object data generated in the data generation step,
In the data generation step,
A data acquisition process for acquiring object data, which is data generated by scanning a human being, which is the object of modeling, with a 3D scanner;
A data correction process for correcting the object data;
a data generation process for generating the object data based on the object data corrected in the data correction process;
the target object data is data indicating at least a shape of at least a part of the human, including a face of the human, and a color of each position on a surface of the shape;
A modeling method comprising the steps of: correcting the object data in the data correction process to change a state of the human face represented by the object data.

Images