JP7792804B2 - Information processing device, control method, and program - Google Patents

Description

The present invention relates to an information processing device, a control method, and a program, and in particular to a technology for simulating the feeling of wearing clothing.

There is technology for generating 3D avatars that reflect a person's appearance. Patent Document 1 discloses technology for generating a 3D avatar of a person that reflects the characteristics of that person's skeleton, face, hair, skin color, and clothing, based on various images obtained of that person.

3D avatars that reflect a person's appearance, such as those described in Patent Document 1, can be used to check how the garment will fit and adjust the size by adding a clothing model (Patent Document 2). In particular, in the field of custom-made or handmade clothing, it is difficult to check how the garment will fit before or during the production process, so a 3D model of the person wearing the garment (wearer) can be used to check the image, etc.

JP 2014-522536 A Japanese Patent Application Laid-Open No. 2020-170394

By the way, some custom-made and handmade clothing has a fixed motif, such as clothing (costumes) that imitate the outfits of characters from movies, animations, games, etc. In such cases, the image of the motif may be formed by incorporating the physical characteristics (body shape) of the character. Therefore, if clothing is simply made to fit the user's body shape, there is a possibility that the image of the motif will not be reproduced when the clothing is worn, depending on the degree of difference between the character's and the wearer's body shapes.

The present invention was made in consideration of the above-mentioned problems, and aims to provide an information processing device, control method, and program for creating a wearer model that matches the image of a motif.

In order to achieve the above-mentioned object, the information processing device of the present invention is an information processing device having a presentation means for applying a clothing model constructed based on the clothing of a motif character to a wearer model and presenting it, and has a first acquisition means for acquiring body type information of the wearer, a first configuration means for configuring a first wearer model based on the wearer's body type information, a second acquisition means for acquiring body type information and clothing information of the character, a transformation means for configuring a second wearer model by transforming the first wearer model based on the character's body type information, and a second configuration means for configuring a first clothing model that fits the second wearer model based on the character's clothing information, and is characterized in that the presentation means presents the second wearer model to which the first clothing model has been applied.

With this configuration, the present invention makes it possible to create a wearer model that matches the image of the motif.

FIG. 1 is a diagram illustrating the configuration of a support system according to an embodiment and a modification of the present invention. FIG. 1 is a block diagram illustrating a functional configuration of a support server 100 according to an embodiment and a modification of the present invention. FIG. 1 is a block diagram illustrating a functional configuration of a client device 200 according to an embodiment and a modification of the present invention. FIG. 10 is a diagram illustrating a provision screen displayed in relation to the provision of a support service according to an embodiment and a modification of the present invention. FIG. 1 is a diagram illustrating measurement information according to an embodiment and a modification of the present invention. FIG. 10 is a diagram illustrating a color adjustment function of the support service according to the embodiment and modified examples of the present invention. FIG. 1 is a diagram illustrating skin color classification according to an embodiment and a modification of the present invention; 1 is a flowchart illustrating an image generation process executed by the support server 100 according to the first embodiment of the present invention. 10 is a flowchart illustrating an image generation process executed by the support server 100 according to the second embodiment of the present invention. FIG. 10 is a diagram illustrating a provision screen displayed in relation to the provision of a support service according to a second embodiment of the present invention; 10 is a flowchart illustrating an image generation process executed by the support server 100 according to the third embodiment of the present invention. FIG. 13 is a diagram illustrating a body shape correction function of a support service according to a ninth modified example of the present invention. FIG. 10 is a diagram showing an example of the data structure of various information used in the support system according to the embodiment and the modification of the present invention.

[Embodiment 1]
Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. Note that the following embodiments do not limit the scope of the invention claimed. Although multiple features are described in the embodiments, not all of these multiple features are necessarily essential to the invention, and multiple features may be combined arbitrarily. Furthermore, in the accompanying drawings, the same reference numerals are used to designate the same or similar components, and redundant explanations will be omitted.

In the embodiment described below, the present invention is applied to a support server, as an example of an information processing device, capable of presenting a wearer model to which a clothing model configured based on the clothing of a motif character is applied. However, the present invention is applicable to any device capable of creating a wearer model to which a clothing model configured based on the clothing of a motif character is applied. Furthermore, in this specification, "character" is not limited to fictional characters in manga, anime, picture books, novels, movies, etc., but also includes real-world people such as actors, as well as people, animals, and living organisms whose appearance is fixed by clothing. Furthermore, a "wearer model" is computer graphics whose appearance is configured to reflect the wearer's appearance (body shape and skin color), and a "clothing model" is computer graphics whose appearance is configured based on the clothing of a motif character.

<<Support system configuration>>
1 is a diagram showing the configuration of a support system for providing a support service for supporting clothing production according to an embodiment of the present invention. As shown in the figure, the support system includes a support server 100 that executes various processes for the support service, a client device 200 used by a user, and a network 300 that connects these devices so that they can communicate with each other.

Here, the support service provided by the support system is a service that provides the function of constructing a clothing model to be made and applying it to a wearer model to visualize it in order to support the user in making clothing. More specifically, the support server 100 constructs a clothing model and a wearer model in response to receiving information about the clothing the user wishes to make from the client device 200, and realizes a support service that presents the clothing model and a wearer model in a format that can be displayed on the client device 200.

The support service may be provided in any manner, but in this embodiment, it is provided as a web service. In other words, a user can use the support service by accessing a specific website where the support server 100 provides functions using a web browsing application (hereinafter simply referred to as a browser) executed on the client device 200. Specifically, by performing the necessary input operations on the website, the user can view a wearer model with a clothing model associated with the desired outfit applied to it.

In the following description, to facilitate understanding of the invention, the user of the support service is assumed to be the wearer who will wear the clothes they have created, and the wearer model is assumed to be an avatar associated with the user. In other words, the user can check the clothes they wish to create as applied to the avatar associated with them, and can check how the clothes will feel and look when worn by the user while they are still incomplete. For this reason, in the following description, the user of the support service may be referred to as the "wearer." It goes without saying that the user of the support service is not limited to the wearer, but may also include someone who has been requested by the wearer to create clothes.

Furthermore, the client device 200 may be a general-purpose device equipped with information and communication functions, such as a smartphone or PC. Furthermore, in the support system of this embodiment, the network 300 is described as a wide-area network such as the Internet, so that it can be used by users in various locations. However, in situations where services are provided in a limited location, such as a clothing store, the network 300 may be a LAN.

The functional configuration involved in realizing the functions of the present invention will be further explained below with reference to the figures.

<Functional configuration of the support server 100>
First, the functional configuration of the support server 100 of this embodiment will be described with reference to the block diagram of FIG.

The control unit 101 is a control device such as a CPU, and controls the operation of each block of the support server 100. Specifically, the control unit 101 reads the operation programs of each block stored in the storage device 102, expands them into memory 103, and executes them to control the operation of each block.

The storage device 102 is a non-volatile storage device capable of permanently storing information, such as a ROM or HDD. The storage device 102 stores not only the operation programs of each block held by the support server 100, but also information such as parameters required for the operation of each block. In addition, the storage device 102 of this embodiment includes a group of databases (wearer DB 110, characteristic DB 120, character DB 130, and adjustment DB 140) that manage information referenced in various processes. The memory 103 is a volatile storage device, such as a RAM. The memory 103 is used not only as an area for expanding the operation programs of each block and a working area for each function, but also as a storage area for temporarily recording information output by the operation of each block.

The wearer DB 110 is a database that manages various information (wearer information) about each user (wearer) for the support service of this embodiment. When a user registers to use the support service, wearer information about the user is constructed and stored and managed in the wearer DB 110. As shown in FIG. 13(a), for example, the wearer information may include, in association with a wearer ID 1301 that identifies the wearer, body type information 1302 for specifying the wearer's body type, skin color information 1303 indicating the wearer's skin color, a wearer model 1304 constructed for the wearer, and a clothing model 1305 constructed for the wearer model. Here, the clothing model 1305 is not limited to one type of clothing, but may include multiple types of clothing constructed by the wearer using the support service.

The characteristic DB 120 is a database that manages information (characteristic information) used to identify the wearer's skin color. As will be described in more detail below, the support service of this embodiment derives the user's (wearer's) skin color based on a captured image of the user. The hue of the user's skin color that appears in the captured image depends on the lighting conditions at the time of capture and the conversion characteristics of the imaging device used for the capture. Therefore, in order to derive the wearer's true skin color from the captured image, information on the color conversion characteristics for each combination of imaging device and lighting conditions is managed as characteristic information in the characteristic DB 120. For example, as shown in FIG. 13(b), the characteristic information may include conversion characteristics 1313 that indicate how the subject's true color is converted to appear in the captured image, associated with an imaging device ID 1311 that uniquely identifies the imaging device and an illumination condition ID 1312 that uniquely identifies the lighting condition.

The character DB 130 is a database that manages information (character information) about each of multiple types of characters that are selectable as motifs in the support service. In the support service of this embodiment, a user can select a character to use as a motif and create a clothing model based on the clothing associated with that character. For this reason, the character information may include, for example, as shown in FIG. 13(c), a character ID 1321 that uniquely identifies the character, associated with profile information 1322 indicating the name of the character and the name of the work in which the character appears, and clothing information 1323 indicating the clothing associated with the character.

Adjustment DB 140 is a database that stores adjustment information, including adjustment parameters referenced in the color adjustment of clothing models, described below. Because the overall image (appearance) of a motif is formed by combining the color of a character's clothing and the character's skin color, differences in skin color between the character and the wearer can prevent the image from being reproduced properly. For this reason, the support service of this embodiment has a function for adjusting the color of the clothing model based on the wearer's skin color when constructing the clothing model, thereby improving the reproducibility of the image. Furthermore, in the field of cosplay, it is customary for a wearer to wear clothing created with a character motif and capture their appearance in a photograph to preserve the work as a work of art. Therefore, it is preferable that the color of the clothing be adjusted to optimally represent the wearer's image in the captured image. More specifically, it is preferable that the color of the clothing model be adjusted taking into account the imaging conditions (hereinafter referred to as the planned imaging conditions) for the intended imaging of the wearer wearing the clothing being produced. Therefore, to allow the user to check such adjustment results, the support service is configured to allow the imaging device to be used for imaging and the lighting conditions during imaging to be set as planned imaging conditions, and manages adjustment parameters corresponding to the wearer's skin color for each planned imaging condition. As shown in FIG. 13(d), for example, the adjustment information may include an adjustment ID 1331 that uniquely identifies the adjustment information, an imaging device ID 1332 that uniquely identifies the imaging device to be used and an illumination condition ID 1333 that uniquely identifies the illumination conditions as planned imaging conditions, associated with skin color classification information 1334 that specifies the skin color classification for which adjustment is to be made, and adjustment parameters 1335 related to each skin color classification.

The construction unit 104 constructs various models used in the support service. In this embodiment, the construction unit 104 constructs a wearer model corresponding to each user and a clothing model to be applied to the wearer model. In the support service aspects described below, the various models constructed by the construction unit 104 will be described as 3D models.

The rendering unit 105 performs rendering processing of the model configured by the configuration unit 104. In the support system of this embodiment, the model is rendered by the support server 100, and the rendering results are sent to the client device 200 and presented to the user via a browser. Therefore, the rendering unit 105 performs rendering processing of the model based on specified rendering conditions, and stores the resulting image in the memory 103 as the rendering result.

The output unit 106 outputs information other than that used for presentation, regarding the clothing model constructed via the support service. In this embodiment, the output unit 106 outputs information for producing clothing based on the clothing model. Here, the information for producing clothing may include, for example, a pattern for cutting the necessary fabric, information on the fabric to be used, and information on products that can be used for processing. Alternatively, the information output by the output unit 106 may be a wearer model (3D model) to which the clothing model has been applied, a three-dimensional drawing (2D image) constructed based on this, or the like.

The communication unit 107 is a communication interface that the support server 100 has with external devices. In the support system of this embodiment, the communication unit 107 communicates information with each client device 200 via the network 300.

In this embodiment, in order to facilitate understanding of the invention, the various functions related to providing support services are described as being realized by the support server 100 alone, but the implementation of the present invention is not limited to this. The various functional configurations may be distributed across multiple devices connected to each other in the support system, and the corresponding functions may be realized by the cooperation of these multiple devices.

<Functional Configuration of Client Device 200>
Next, the functional configuration of the client device 200 of this embodiment will be described with reference to the block diagram of Fig. 3. In the description of the functional configuration of the client device 200, a configuration that realizes the same functions as the configuration of the support server 100 will be referred to with the prefix "client" to clearly distinguish it from the configuration of the support server 100.

The client control unit 201 is a control device such as a CPU, and controls the operation of each block of the client device 200. Specifically, the client control unit 201 reads the operation programs of each block stored in the client storage device 202, expands them into the client memory 203, and executes them to control the operation of each block.

The client storage device 202 is a non-volatile storage device capable of permanently storing information, such as a ROM or HDD. The client storage device 202 stores not only the operating programs of each block of the client device 200, but also information such as parameters required for the operation of each block. The client memory 203 is a volatile storage device, such as a RAM. The client memory 203 is used not only as an area for expanding the operating programs of each block and a working area for each function, but also as a storage area for temporarily recording information output by the operation of each block.

The display control unit 204 controls the display of information via the display unit 210 on the client device 200. The display control unit 204 includes a drawing device such as a GPU or drawing chip, and performs predetermined drawing processing to generate a screen to be displayed on the display unit 210. Since the support service of this embodiment is provided via a browser, the display control unit 204 generates a screen including display items within the browser's display area based on information on the necessary display elements received from the support server 100. The display unit 210, which realizes the information display, is a display device such as an LCD display, and displays the display screen generated by the display control unit 204.

The operation input unit 205 is a user interface that the client device 200 has, such as operation members such as buttons and various sensors. When the operation input unit 205 detects that an operation input has been made to an operation member or that a predetermined sensor output has been obtained, it outputs a control signal corresponding to the operation input to the client control unit 201. The operation input unit 205 may include, for example, a touch detection sensor or touch panel that detects touch input made on the display screen of the display unit 210.

The client communication unit 206 is a communication interface that the client device 200 has with external devices. In the support system of this embodiment, the client communication unit 206 communicates information with the support server 100 via the network 300.

Service Overview
An outline of the support service provided by the support system of this embodiment will be described below. As described above, the support service provides a function for constructing a clothing model adapted to a wearer model and presenting the clothing model after applying it to the wearer model in order to support a user in creating clothing. Therefore, the functions provided by the support service include the functions of constructing a wearer model based on the wearer's physique information, constructing a clothing model based on costume information of a motif character, adjusting the clothing model, and presenting the wearer model in a state in which the clothing model has been applied. Furthermore, the functions provided by the support service further include the function of outputting information for creating clothing corresponding to the constructed clothing model.

Figure 4(a) shows an example of a provision screen 400 presented in connection with the provision of a support service. The provision screen 400 is a screen received by the client device 200 used by each user and displayed on the display unit 210. The support server 100 generates various display elements required to configure the provision screen 400 and transmits these display elements to the client device 200 via the network 300, thereby presenting these display elements.

The provided screen 400 includes a wearer model image 401 with a predetermined clothing model applied. In the state shown in FIG. 4(a), the wearer model image 401 is presented with the clothing model applied, but if the clothing model has not yet been configured, the wearer model image 401 may be presented without the clothing model applied. The user can select a character outfit to use as the clothing model motif for the wearer model image 401 by operating the clothing menu 402. In the support service of this embodiment, character information related to compatible characters is managed in the character DB 130, and the user can select one character from this to select the character's outfit as the motif. Once the character outfit motif is confirmed, a clothing model is configured to fit the wearer model, and the provided screen 400 displays the wearer model image 401 with the configured clothing model applied.

<Wearer model configuration functions>
First, the configuration function of the wearer model presented on the presentation screen 400 will be described.

To present the wearing comfort of clothing in an appropriate manner, the wearer model is configured to conform to the wearer's body shape. In this embodiment, the wearer's body shape information is described as measurement information entered by the user acquired when using the support service. The measurement information includes circumferences such as neck circumference 501, bust 502, armholes 503, waist 504, mid-hip 505, hips 506, arm circumference 507, elbow circumference 508, and wrist circumference 509, as shown in FIG. 5(a). The measurement information also includes widths such as chest width 511, breast width 512, back width 513, shoulder width 514, and back-shoulder width 515, as shown in FIG. 5(b). The measurement information also includes, for example, as shown in FIG. 5(c), length dimensions such as front length 521, breast drop 522, back length 523, back length 524, total back length 525, mid-hip length 526, waist length 527, rise 528, sleeve length 529, and sleeve length 530. When the user inputs the measurement information, the control unit 101 updates the body type information 1302 of the wearer information related to the user managed in the wearer DB 110.

Note that the measurement information shown in Figure 5 does not necessarily need to be entered; for example, after the motif character costume has been finalized, the input of the dimensions necessary to produce the clothing associated with that costume may be requested. In other words, once a character has been selected, the input of measurement information for the body parts that form the character's distinctive appearance (for example, sleeve length for a character with long arms, or bust for a character with a large bust) may be required. Therefore, the construction of the wearer model and the selection of the motif character may be performed in either order.

The wearer's skin color is reflected in the wearer model so that the contrast between the wearer's skin color and the color of the clothing and the reproducibility of the overall motif image can be confirmed. In this embodiment, information about the wearer's skin color (skin color information) is acquired based on the captured image of the wearer received from the client device 200. More specifically, the control unit 101 analyzes the captured image to detect the person's skin area in the image and determines the wearer's skin color, for example, based on the most frequently occurring pixel value in the skin area. Here, the skin area may be identified, for example, by detecting the person's facial area and identifying it based on the facial area. Furthermore, because the color representation of the person's skin color in the captured image differs depending on the characteristics of the imaging device that captured the image and the lighting conditions at the time of capture, the control unit 101 determines the wearer's skin color based on this information. Therefore, the control unit 101 determines the wearer's skin color by correcting the color of the wearer's skin area in the captured image based on the characteristics information of the imaging device and the lighting conditions. The imaging device characteristic information and lighting condition information may be obtained from EXIF information included in the captured image, or may be obtained based on user input. Once the control unit 101 determines the wearer's skin color, it updates the skin color information 1303 of the wearer information related to the user (wearer) managed in the wearer DB 110.

Note that the skin color of the wearer derived using this method does not strictly represent the natural skin color of the wearer, but rather the skin color of the wearer under the conditions at the time of image capture. For example, if the wearer is wearing makeup such as foundation at the time of image capture, the skin color of the wearer derived using this method will be the skin color under makeup, not the natural skin color.

When meaningful information is input into the body type information 1302 and skin color information 1303 of the wearer information in this way, the construction unit 104 can construct a wearer model. Construction of the wearer model may be performed, for example, when the presentation screen 400 shown in FIG. 4(a) is displayed, or when input of the body type information 1302 and skin color information 1303 is completed. The construction unit 104 constructs the wearer model based on the body type information 1302 and skin color information 1303 of the wearer information related to the target user. The wearer model constructed by the construction unit 104 is stored in the wearer model 1304 of the wearer information related to the target user and managed in the wearer DB 110.

<Clothing model composition>
Next, a description will be given of the function of constructing a clothing model that is applied to a wearer model and presented on the presentation screen 400. Once a motif character is selected as described above, the construction unit 104 constructs a clothing model that fits the wearer model based on the character information associated with the character and managed in the character DB 130. In this embodiment, the clothing information 1323 of the character information stores a 3D model that represents clothing that fits the character's defined body type. The construction unit 104 constructs a clothing model that fits the wearer model by applying deformations that stretch each part of the 3D model to fit the dimensions of the corresponding part of the wearer. For example, the 3D model defined in the clothing information 1323 has reference points (such as vertices or bone endpoints) that serve as references for stretching, and the construction unit 104 moves these reference points according to the corresponding dimensions of the wearer. The construction unit 104 also constructs a clothing model that fits the wearer model by moving other vertices between the reference points to positions that correspond to the positions of the moved reference points. The clothing model constructed by the construction unit 104 is additionally stored in the clothing model 1305 of the wearer information related to the target user and managed in the wearer DB 110.

<Wearing status notification function>
When a wearer model related to the user and a clothing model related to the selected character are configured in this manner, it becomes possible to present a wearer model image 401 wearing the clothing related to the clothing model on the provided screen 400. In the support system of this embodiment, a two-dimensional image generated by drawing a 3D model in the support server 100 is provided to the client device 200 as an element (display element) required for displaying the provided screen 400. Therefore, the drawing unit 105 draws a wearer model to which the clothing model is applied, thereby generating a display element (two-dimensional image) related to the wearer model image 401 and presenting it on the client device 200.

<Color adjustment function>
However, the color scheme used in the 3D model of each character previously stored in the character DB 130 may not create a favorable image when matched with the skin color of the wearer. This is because, when the motif is an existing character, the character's unique image (appearance impression) is already formed by the character's skin color and the color scheme of the character's clothing. For this reason, in the support service of this embodiment, a color-adjusted clothing model is further created by adjusting the color of a clothing model, which is configured only by modifying it to fit the wearer model, to match the wearer's skin color. Hereinafter, a clothing model configured by modifying a pre-existing 3D model for a character will be referred to as the "pre-adjusted clothing model," and a clothing model configured by further adjusting the color of the pre-adjusted clothing model based on the wearer's skin color information will be referred to as the "adjusted clothing model."

The adjusted clothing model is constructed, for example, in response to an operation input received on the color adjustment menu 403 on the provision screen 400 in FIG. 4(a). In the support service of this embodiment, the construction unit 104 adjusts the color of the pre-adjusted clothing model so that the colors will create a character-specific image in the image that is to be taken of a wearer wearing clothing created based on the adjusted clothing model. In other words, the construction unit 104 adjusts the color of the pre-adjusted clothing model so that the image of the wearer wearing the clothing will have a color scheme that creates a character-specific image in the captured image obtained by the image capture. Therefore, in this embodiment, the color scheme of the adjusted clothing model is determined not only based on the skin color of the wearer, but also taking into account the imaging conditions (planned imaging conditions) of the actual imaging that is to be taken.

When an operation input to the color adjustment menu 403 is accepted, a setting screen 600 is presented, as shown in FIG. 6, which has a setting item 601 for setting the imaging device to be used for imaging and a setting item 602 for setting the lighting conditions during imaging. By setting and confirming these setting items for the planned imaging, the user can perform color adjustments to create an optimal image of the wearer and their clothing in the captured image. Here, the lighting conditions during imaging can be set based on, for example, the location where imaging will be performed (a studio, event venue, or facility) and the lighting equipment to be used.

When the planned imaging conditions are set using these setting items, the control unit 101 acquires adjustment parameters for color adjustment of the pre-adjusted clothing model from the adjustment information for the planned imaging conditions managed in the adjustment DB 140, and causes the composition unit 104 to perform color correction using the adjustment parameters. The adjustment parameters are set in advance according to the wearer's skin color, and in this embodiment, they differ depending on which skin color classification defined in the skin color classification information 1334 of the adjustment information the wearer's skin color belongs to. More specifically, the adjustment parameters 1335 of the adjustment information include adjustment parameters for each skin color classification defined in the skin color classification information 1334, and the control unit 101 acquires the adjustment parameters defined for the skin color classification corresponding to the wearer. That is, the control unit 101 acquires adjustment parameters related to the skin color classification to which the wearer's skin color belongs from the adjustment information corresponding to the planned imaging conditions, transmits them to the composition unit 104, and causes the composition unit 104 to perform color adjustment of the pre-adjusted clothing model.

Here, the skin color classification defined in the skin color classification information 1334 of the adjustment information for one planned imaging condition may be determined by a distribution in a color space, such as that shown in FIG. 7(a). In the example of FIG. 7(a), subspaces defining four types of skin color classifications are defined in a color space represented by three RGB axes. When the RGB values of the wearer's skin color are mapped to this color space, it is determined which subspace the skin color belongs to. Here, each subspace is defined so that similar skin colors under the planned imaging conditions are classified as the same skin color classification. Therefore, in the example of FIG. 7(a), the skin color classification information 1334 includes information defining the range of each subspace, and the adjustment parameters 1335 include adjustment parameters (adjustment coefficients) for adjusting the color of the pre-adjustment clothing model for each subspace, as shown in FIG. 7(b). For example, if the wearer's skin color belongs to subspace B, the color adjustment parameters of the pre-adjusted clothing model applied to the wearer model for that wearer are an R component adjustment coefficient of 0.99, a G component adjustment coefficient of 0.99, and a B component adjustment coefficient of 1.01. The adjustment coefficients are experimentally determined values that adapt the color of the pre-adjusted clothing model to the colors in the skin color classification. Therefore, the construction unit 104 constructs the adjusted clothing model by adjusting the RGB values of each color in the color scheme information used in the pre-adjusted clothing model to values multiplied by the adjustment coefficients corresponding to the R component, G component, and B component, respectively. The adjusted clothing model constructed by the construction unit 104 is additionally stored in the clothing model 1305 of the wearer information related to the target user managed in the wearer DB 110 in a manner that allows it to be distinguished from the pre-adjusted clothing model.

Once the planned imaging conditions are set in this way, the display returns from the setting screen 610 to the provision screen 400, and the wearer model image 401 is presented with the adjusted clothing model applied. That is, the drawing unit 105 draws the wearer model with the adjusted clothing model applied, thereby generating display elements related to the wearer model image 401 and presenting them on the client device 200.

<Output function>
Furthermore, the support service of this embodiment can output information for producing clothing corresponding to the clothing models thus constructed (pre-adjustment clothing model and post-adjustment clothing model). The output of information for producing clothing is triggered by receiving an output request from the client device 200. The clothing model to be output may be selectable between the pre-adjustment clothing model and the post-adjustment clothing model. For example, if an output request is received while the color adjustment function is being used, information corresponding to the post-adjustment clothing model may be output, and if an output request is received without using the color adjustment function, information corresponding to the pre-adjustment clothing model may be output.

In this embodiment, the information for producing clothing corresponding to a clothing model includes information indicating the fabric corresponding to the color of the clothing model, and information on the pattern for cutting from the fabric.

Image generation processing
Hereinafter, specific processing will be described with reference to the flowchart in Fig. 8 regarding image generation processing in the assistance server 100 of this embodiment for generating display elements (two-dimensional images) to be presented on the client device 200 used by the user. The processing corresponding to the flowchart can be realized by the control unit 101 reading out a corresponding processing program stored in, for example, the storage device 102, expanding it in the memory 103, and executing it. This image generation processing will be described as being started when, for example, a display request for the provided screen 400 or a display update request for the wearer model image 401 is received from the client device 200 using the assistance service.

It is assumed that prior to executing this image generation process, a wearer model for the user (target wearer) using the client device 200 and a clothing model for the costume of the motif character (target character) have been constructed. In other words, the wearer information managed in the wearer DB 110 for the target wearer already contains the necessary information in body type information 1302, skin color information 1303, and wearer model 1304. It is also assumed that the clothing model 1305 of the wearer information contains the pre-adjustment clothing model for the target character.

In S801, the control unit 101 determines whether the color adjustment function is currently being used. The usage status of the color adjustment function may be changed, for example, each time an operation input is made to the color adjustment menu 403 on the display of the provision screen 400. In this case, the control unit 101 updates the value of the adjustment in progress flag (logical type) stored in the memory 103 in response to receiving information from the client device 200 indicating that the operation input has been made, and makes the determination in this step by referencing the adjustment in progress flag. The adjustment in progress flag may, for example, be "True" to indicate that the color adjustment function is being used, or "False" to indicate that the color adjustment function is not being used, and may be updated to a value different from the current value in response to receiving information indicating that an operation input has been made to the color adjustment menu 403. If the control unit 101 determines that the color adjustment function is being used, it proceeds to S802; if it determines that the color adjustment function is not being used, it proceeds to S807.

In S802, the control unit 101 determines whether or not planned imaging conditions have been set. If the control unit 101 determines that planned imaging conditions have been set, it proceeds to S806; if it determines that planned imaging conditions have not been set, it proceeds to S803.

In S803, the control unit 101 accepts the setting of the planned imaging conditions. Once the planned imaging conditions are confirmed, the control unit 101 proceeds to S804.

In S804, the control unit 101 acquires adjustment parameters related to color adjustment of the pre-adjustment clothing model. More specifically, the control unit 101 identifies the skin color classification to which the color indicated in the skin color information 1303 of the wearer information related to the target wearer belongs, based on the skin color classification information 1334 of the adjustment information corresponding to the planned image capture conditions confirmed in S803. The control unit 101 then acquires adjustment parameters related to the identified skin color classification from the adjustment parameters 1335 of the adjustment information.

In S805, under the control of the control unit 101, the construction unit 104 constructs an adjusted clothing model by adjusting the color of the pre-adjustment clothing model for the target character using the adjustment parameters acquired in S804. The constructed adjusted clothing model is stored in the clothing model 1305 of the wearer information for the target wearer.

In S806, under the control of the control unit 101, the drawing unit 105 draws a wearer model of the target wearer to which the adjusted clothing model for the target character has been applied, and generates a display element (two-dimensional image).

On the other hand, if it is determined in S801 that the color adjustment function is not in use, the drawing unit 105, under the control of the control unit 101, draws a wearer model of the target wearer by applying the pre-adjustment clothing model for the target character in S807, and generates display elements.

At S808, the control unit 101 presents the generated display elements to the client device 200 associated with the target wearer, completing the image generation process. More specifically, the control unit 101 transmits the display elements to the communication unit 107 and has them sent to the client device 200, thereby presenting the display elements to the client device 200. Note that in this embodiment, the presentation of a wearer model to which a clothing model has been applied has been described as being realized by rendering the wearer model and providing (transmitting) a two-dimensional image generated from the model, but the present invention is not limited to this. Presentation may also be realized, for example, by constructing a wearer model to which the clothing model has been applied (generating a 3D model by combining the clothing model and the wearer model) and providing this.

As described above, the information processing device according to this embodiment can create a clothing model that optimally reproduces the image of a motif, and apply it to a wearer model for presentation.

[Modification 1]
In the above-described embodiment, the skin color of the wearer is determined by adjusting the color of the skin region in the captured image of the wearer based on the characteristic information of the imaging device and the information on the lighting conditions, but the implementation of the present invention is not limited to this. It goes without saying that, in an aspect where at least one of the imaging device used and the lighting conditions at the time of capturing the captured image is fixed for the captured image captured when determining the skin color information of the wearer, it is not necessary to acquire either or both of the characteristic information of the imaging device and the information on the lighting conditions.

[Modification 2]
In the above-described embodiment and modified examples, the skin color information of the wearer is described as being acquired by analyzing the captured image of the wearer, but the present invention is not limited to this. The skin color information of the wearer may be acquired based on, for example, information specifying the foundation used by the wearer.

[Modification 3]
In the above-described embodiment, input measurement information is used as the wearer's physique information, but the present invention is not limited to this. The wearer's physique information may be obtained, for example, by analyzing a captured image or depth image of the wearer's entire body. The analysis process may include identifying joint positions from an image of the wearer and deriving the distance between the joints based on preset information such as the wearer's height.

[Modification 4]
In the above-described embodiment, the wearer model is configured based on the body shape information of the wearer, but the implementation of the present invention is not limited to this. For example, in an application simply aiming to compare the skin color of the wearer with the color of the clothing, the body shape information of the wearer does not need to be reflected in the wearer model, and a 3D model of a fixed human body shape that reflects only the skin color information of the wearer may be used as the wearer model.

[Modification 5]
In the above-described embodiment, the adjustment parameters for color adjustment to construct the adjusted clothing model are determined based on which skin color category, defined for the set planned image capture conditions, the wearer's skin color belongs to. However, the present invention is not limited to this. For example, instead of the planned image capture conditions, adjustment information may be provided for each costume of the motif character and managed in the adjustment DB 140. That is, in this modification, the adjustment information managed in the adjustment DB 140 includes skin color category information 1334 and adjustment parameters 1335 associated with an adjustment ID 1331 and a costume ID 1341 that uniquely identifies the costume information, as shown in FIG. 13( e). In this case, the adjustment parameters used to adjust the color of the pre-adjusted clothing model may be obtained based on the wearer's skin color information from the adjustment information associated with the costume information of the target character.

Note that a character may have multiple types of costumes. In this case, the costume information 1323 of the character information managed in the character DB 130 includes 3D models corresponding to each of the multiple types of costumes. For example, when a character with multiple types of costume information is selected as a motif, the user is further prompted to select which of the character's costumes they wish to create clothing for. That is, the user is prompted to select which of the character's costumes the clothing model to be applied to and presented on the presentation screen 400 and applied to the wearer model image 401 corresponds to. Once the costume is selected, the construction unit 104 constructs a pre-adjustment clothing model using one type of 3D model corresponding to the selected costume. When color adjustment is performed, the control unit 101 references the adjustment information for the selected costume (the costume ID 1341 identifies the costume) and acquires adjustment parameters. In this case, the color adjustment of the pre-adjustment clothing model is not performed taking into account any planned imaging conditions, but is performed to match the wearer's skin color so as to form an overall image of the motif under specific imaging conditions.

In addition, the adjustment information is not limited to information defined for either the planned image capture conditions or the selected outfit, but may be provided for each combination of outfit type and planned image capture conditions. That is, the adjustment information may be configured to manage skin color classification information 1334 and adjustment parameters 1335 in association with adjustment ID 1331, planned image capture conditions (image capture device ID 1332 and lighting condition ID 1333), and outfit ID 1341. In this case, when color adjustment is performed, the control unit 101 obtains adjustment parameters corresponding to the wearer's skin color from the adjustment information related to the planned image capture conditions of the selected outfit.

[Modification 6]
In the above-described embodiment and Modification 6, a skin color classification is defined in the skin color classification information 1334 included in the adjustment information, the skin color classification to which the wearer's skin color belongs is identified, and adjustment parameters related to the skin color classification are acquired for constructing an adjusted clothing model. However, the present invention is not limited to this. An LUT (Look Up Table) may be provided that defines adjustment parameters not for each skin color classification but for each skin color of the wearer, and adjustment parameters corresponding to the wearer's skin color may be directly acquired from the LUT.

[Embodiment 2]
In the above-described first embodiment and first to sixth modifications, it has been described that when color adjustment is performed to match the skin color of the wearer, the wearer model image 401 to which the adjusted clothing model has been applied is presented on the presentation screen 400. That is, the presentation of the wearer model image 401 can be switched between applying the adjusted clothing model or applying the unadjusted clothing model to the wearer model representing the skin color of the wearer, depending on whether the color adjustment function is being used. That is, the user can switch on the presentation screen 400 between viewing a state in which a clothing model with a color that approximates the overall image of the motif has been applied to a wearer model representing the user's own skin color, and viewing a state in which a clothing model with a color unique to the motif has been applied.

However, the image originally created by the motif character may differ strictly from the image created by a wearer model to which an adjusted clothing model has been applied. In other words, if the skin color of the wearer differs from the skin color of the character, the wearer model to which an adjusted clothing model has been applied will merely create an image that is close to the motif within the range of the wearer's skin color, making it difficult for the user to grasp the difference from the original image.

For this reason, the support service of this embodiment provides the following presentation switching function while using the color adjustment function, so that the user can grasp the difference between the image originally formed by the motif character and the image formed by a wearer model to which the adjusted clothing model has been applied. The presentation switching function is a function that switches, while using the color adjustment function, between a presentation in which the adjusted clothing model is applied to the wearer model shown in embodiment 1, and a presentation in which the pre-adjusted clothing model is applied to a wearer model showing the character's original skin color. In other words, the user can view their own wearer model in two states: (1) a state in which the wearer model shows their own skin color and is wearing clothing that has been color-adjusted to match that skin color, and (2) a state in which the wearer model shows the motif character's original skin color and is wearing clothing that shows the color scheme unique to that character's costume.

For this reason, in the support system of this embodiment, the character information managed in the character DB 130 for each character further includes skin color information 1351 indicating the character's unique skin color, as shown in FIG. 13(f). Therefore, the configuration unit 104 configures the wearer model for presentation (2) above (hereinafter referred to as the motif color wearer model) by changing the skin color of the wearer model based on the skin color information 1351 related to the motif character. The motif color wearer model configured by the configuration unit 104 is stored in the wearer model 1304 of the wearer information managed for the target user in the wearer DB 110 in a manner that allows it to be distinguished from the wearer model configured based on the wearer's skin color information.

Note that the presentation switching may be triggered by an operation input to the unique color scheme display button 411 provided on the presentation screen 400 presented while the color adjustment function is being used, as shown in FIG. 4(b), for example. The unique color scheme display button 411 is a GUI configured to switch its selection state each time an operation input is made. When selected (ON), the unique color scheme display is performed, i.e., a motif color wearer model to which the pre-adjustment clothing model has been applied is presented. When unselected (OFF), the unique color scheme display button 411 does not display the unique color scheme, i.e., a wearer model to which the post-adjustment clothing model has been applied is presented. The selection state of the unique color scheme display button 411 is managed, for example, by a unique color scheme in progress flag (logical type) stored in memory 103, and the value may be changed each time an operation input is made to the unique color scheme display button 411 on the presentation screen 400. For example, when the unique color scheme in progress flag is "True," it indicates that the unique color scheme display button 411 is selected and the unique color scheme display is to be performed, and when it is "False," it indicates that the unique color scheme display button 411 is not selected and the unique color scheme display is not to be performed. Therefore, in response to receiving information from the client device 200 indicating that an operation input has been made to the unique color scheme display button 411, the control unit 101 updates the value of the unique color scheme in progress flag to a value different from the current value.

Image generation processing
Specific processing of the image generation process (while the color adjustment function is being used) for generating display elements (two-dimensional images) to be presented on the client device 200 used by the user in the support server 100 of this embodiment will be described below with reference to the flowchart in Fig. 9. The processing corresponding to the flowchart can be realized by the control unit 101 reading out a corresponding processing program stored in the storage device 102, for example, and expanding and executing the program in the memory 103. This image generation process will be described as being started when, for example, a request to use the color adjustment function while the provided screen 400 is being displayed or a request to update the display of the wearer model image 401 while the function is being used is received from the client device 200 using the support service.

It is assumed that, prior to execution of this image generation process, a wearer model for the user (target wearer) using the client device 200, and pre-adjusted and post-adjusted clothing models for the costume of the motif character (target character) have been constructed. In other words, it is assumed that the wearer information for the target wearer managed in the wearer DB 110 already contains the necessary information in body type information 1302, skin color information 1303, and wearer model 1304. It is also assumed that the planned imaging conditions have been set, and pre-adjusted and post-adjusted clothing models for the target character have been stored in clothing model 1305 of the wearer information. In the following explanation, steps that perform the same processes as in the image generation process of embodiment 1 are assigned the same reference numbers, and explanations thereof will be omitted.

In S901, the control unit 101 determines whether or not to display the unique color scheme. This determination in this step is made by referencing the unique color scheme in progress flag. If the control unit 101 determines that the unique color scheme should be displayed, it proceeds to S902; if it determines that the unique color scheme should not be displayed, it proceeds to S806.

In S902, the control unit 101 determines whether a motif color wearer model has been configured. The determination in this step is made based on whether a motif color wearer model is stored in the wearer model 1304 of the wearer information of the target wearer. If the control unit 101 determines that a motif color wearer model has been configured, it proceeds to S904; if it determines that a motif color wearer model has not been configured, it proceeds to S903.

In S903, under the control of the control unit 101, the construction unit 104 constructs a motif color wearer model by changing the color of the wearer model of the target wearer based on the skin color information 1351 of the character information related to the target character. The constructed motif color wearer model is stored in the wearer model 1304 of the wearer information related to the target wearer.

At S904, under the control of the control unit 101, the drawing unit 105 draws a motif color wearer model of the target wearer to which the pre-adjustment clothing model for the target character has been applied, and generates a display element (two-dimensional image).

In this way, it is possible to switch between presenting a wearer model to which the adjusted clothing model has been applied and a motif color wearer model to which the pre-adjustment clothing model has been applied, allowing the user to easily determine whether the motif image is being suitably reproduced. In this embodiment, by switching the selection state of the unique color scheme display button 411 on the presentation screen 400, the display elements related to the wearer model image 401 are made different, allowing the user to grasp the image formed by the wearer model to which the adjusted clothing model has been applied. However, the implementation of the present invention is not limited to this, and it is sufficient to present a wearer model to which the adjusted clothing model has been applied and a motif color wearer model to which the pre-adjustment clothing model has been applied in a manner that allows them to be compared; for example, both may be presented simultaneously.

[Modification 7]
In the above-described second embodiment, the character information includes skin color information 1351 indicating a skin color specific to the character, and the configuration unit 104 configures a motif color wearer model by referring to the information. However, the present invention is not limited to this. The character's specific skin color may be acquired from a character image indicating the character, which is transmitted from the client device 200.

Here, the character image may be, for example, an illustration depicting a character in a specific scene, or an image of one frame of a video in which a character appears. In this case, the character's image in the character image has a color that is affected by the lighting conditions of the scene. For example, in an illustration depicting a character in a night scene, the character's skin color may be depicted as being bluer than the character's actual skin color, and simply extracting the color of the character's skin area may not result in the character's actual skin color. Therefore, in the support service of this embodiment, when a character image is acquired from the client device 200 for character skin color information, the lighting conditions for the character image are also accepted. This setting may, for example, allow the user to select a scene that appears in the character image, or a lighting color. Alternatively, the control unit 101 may identify the lighting conditions by analyzing the character image.

Once the character image and the lighting conditions for that character image are set, the control unit 101 corrects the color of the skin area in the character image based on the lighting conditions to estimate the character's original skin color and acquire it for use in constructing a motif color wearer model. This makes it possible to achieve the unique color scheme display of embodiment 2 even in cases where skin color information 1351 is not stored in the character DB 130.

[Modification 8]
The color adjustment described in the above-described embodiment and modified example is performed using adjustment parameters corresponding to the wearer's skin color based on color information (color information) defined in the motif character's clothing information. In this method, the adjustment parameters are determined once the wearer's skin color and the planned imaging conditions are determined. This limits customization, such as reflecting user preferences in the color adjustment. On the other hand, there is also demand for creating clothing with a user-defined color scheme, such as a color scheme that is brighter than the motif character's original color scheme, a color scheme closer to a specific theme color, monochrome, or an original color scheme. Therefore, the color adjustment function described above may be enabled only when it is determined that color information related to the character's clothing information is to be adopted. If the color information is not to be adopted, an interface may be provided that allows the color of the clothing model to be customized. In other words, the construction of an adjusted clothing model is performed only when a setting is made to adopt predetermined color information in the character's clothing information.

[Embodiment 3]
In the above-described embodiment and modified examples, a clothing model is configured to fit a wearer model based on the wearer's physique information, and the clothing model is applied to the wearer model for presentation. However, the present invention is not limited to this. The image (appearance) of a motif character may be formed based on the character's physique. For example, for a muscular/thin character or a character with a large/small chest, the appearance impression (e.g., muscular or large chest) is formed based on the character's physique, not just the costume and its color scheme. Therefore, if the physique of the motif character differs from the physique of the wearer, configuring a clothing model to fit the wearer model will not adequately reproduce the character's appearance, even when the wearer wears clothing created based on the clothing model. Such a difference in physique is not limited to cases where the character's physique has distinctive features. For example, it can also occur when a female wearer wears a male character's clothing (cross-dressing) or a male wearer wears a female character's clothing (cross-dressing). In order to absorb the discrepancy between the character's and the wearer's body shape, some wearers use body-shaping materials such as padding, shapewear, and artificial body parts to enhance the reproducibility of the character's appearance.

However, when using body-shaping components, the wearer's body shape will naturally differ from their natural shape, so the wearer must obtain the necessary body-shaping components, take measurements while wearing them, create a clothing pattern, and then begin production. This increases the number of steps required to produce clothing, which can be difficult for inexperienced wearers. In other words, if the body shape of the desired character differs from the wearer's own body shape, the wearer may give up on producing and wearing clothing based on that character. For this reason, the support service of this embodiment also provides functions to create a wearer model that matches the image of the motif, and to create a clothing model that matches the wearer model.

Body shape correction function
The following describes a body shape correction function provided in the support service of this embodiment, which transforms a wearer model into a form corresponding to the body shape of a motif character and configures a new wearer model (hereinafter referred to as a body shape-corrected wearer model). In the support system of this embodiment, the character information managed in the character DB 130 for each character further includes body shape information 1361 indicating the body shape of the character, as shown in FIG. 13( g). Therefore, on the condition that a motif character has been selected, the configuration unit 104 transforms the wearer model configured based on the body shape information of the wearer based on the body shape information 1361 of the character information related to the character, and configures a body shape-corrected wearer model.

The body type information 1361 for a character is assumed to be composed of information on the dimensions of multiple body parts that make up the character. The information on the dimensions of multiple body parts holds values corresponding to the character for at least some of the measurement points on the wearer described using Figure 5. Here, the body parts whose dimensions are included in the body type information 1361 are assumed to include at least body parts that are characteristic in forming the impression of the character's appearance. For example, in the case of a muscular character, the body type information 1361 may include at least the dimensions of the neck circumference, bust, armholes, waist, arm circumference, elbow circumference, chest width, back width, shoulder width, back-shoulder width, and back height, which are characteristic body parts.

The presentation screen presented in connection with the provision of the support service of this embodiment may be, for example, the one shown in FIG. 10(a). Like the presentation screen 400, the presentation screen 1000 is a screen on which the necessary information is received by the client device 200 used by each user and displayed on the display unit 210. The support server 100 generates the various display elements required to configure the presentation screen 1000 and transmits these display elements to the client device 200 via the network 300, thereby presenting these display elements.

Figure 10(a) shows an example of a provided screen 1000 that displays a motif character (and outfit) in a selected state, and presents a wearer model image 1001 to which a clothing model for the character's outfit has been applied. Additionally, a character image for the selected character is displayed in the upper right corner of the provided screen 1000, allowing the user to refer to the image that the character originally formed. The user can change the character's outfit by inputting operations into the outfit menu 1003.

Furthermore, by performing an operation input on the body shape correction menu 1004, the user can change the wearer model image to a presentation mode (wearer model image 1011) that reflects the body shape information of the motif character, as in the provided screen 1010 shown in FIG. 10(b). Whether the wearer model image is a display element drawn using a wearer model corresponding to the wearer's body shape or a body-corrected wearer model corresponding to the character's body shape may be managed, for example, by a body shape correction flag (logical type) stored in memory 103. In other words, whether the provided screen 1000 shown in FIG. 10(a) or the provided screen 1010 shown in FIG. 10(b) is presented is managed by the body shape correction flag. When the body shape correction flag is "True," for example, it indicates that a display element drawn using a body-corrected wearer model (wearer model image 1011) is presented. Furthermore, when the body shape correction flag is "False," it indicates that a display element (wearer model image 1001) drawn using a wearer model is presented. The value of the body shape correction flag may be changed each time an operation input is made to the body shape correction menu 1004 on the presentation screen 1000 or the presentation screen 1010. Therefore, upon receiving information from the client device 200 indicating that an operation input has been made to the body shape correction menu 1004, the control unit 101 updates the value of the body shape correction flag to a value different from the current value.

<Deformation Overview>
Here, the configuration of the body-corrected wearer model used to draw the provided screen 1010 when the provided screen 1010 is presented, i.e., the deformation of the wearer model, will be described in detail. In this embodiment, the deformation of the wearer model is performed by adjusting the dimensional ratio between multiple parts constituting the wearer model to the dimensional ratio between the same parts defined in the body type information of the character. To make it easier to understand the outline of the deformation, the following description will be given taking as an example an example a mode in which dimensions are defined for four types of parts, namely height, bust, waist, and hips, as the body type information of the wearer and the body type information of the character.

For example, the wearer's body shape information and the character's body shape information are
In this case, in order to express the character's body shape in terms of the wearer's scale, each dimension of the character's body shape information is first converted to a value that matches the wearer's height. In the above numerical example, the wearer's height is 160 cm and the character's height is 144 cm, so each dimension of the character's body shape information is
160cm/144cm = 10/9 times the value,
Therefore, the construction unit 104 constructs a body-corrected wearer model by transforming the bust, waist, and hip dimensions of the wearer model so that they match the dimensions of the corresponding parts in the body type information of the converted character. More specifically, the body-corrected wearer model is constructed by transforming the part of the wearer model corresponding to the bust from 75 cm to 90 cm, the part corresponding to the waist from 55 cm to 57.8 cm, and the part corresponding to the hips from 78 cm to 87.8 cm.

Here, each dimension of the converted character is obtained by multiplying the dimension specified in the character's body type information by 10/9, so the ratio of dimensions between each part remains unchanged. That is, for example, the ratio of height to bust (81/144), height to waist (52/144), and height to hips (79/144) are maintained even after the conversion. Therefore, the body-corrected wearer model obtained by modifying to match each dimension of the converted character has the same ratio of dimensions between the same parts as the character's body type information.

By modifying the dimensions of multiple parts of the wearer model constructed based on the wearer's body shape information in this way based on the body shape information of the motif character, it is possible to construct a body-corrected wearer model whose shape is closer to that of the character. The constructed body-corrected wearer model is added to and stored in the wearer model 1304 of the wearer information managed for the target user in the wearer DB 110 in a manner that allows it to be distinguished from the wearer model.

Furthermore, a clothing model configured to fit the wearer model (hereinafter referred to as the pre-correction clothing model) does not fit the body-corrected wearer model. Therefore, when the configuration unit 104 configures a body-correction wearer model, it configures a new clothing model (hereinafter referred to as the post-correction clothing model) that fits the body-correction wearer model. The configured post-correction clothing model is similarly added to and stored in the clothing model 1305 of the wearer information related to the target user in a manner that allows it to be distinguished from the pre-correction clothing model.

<<Body shape correction material suggestion function>>
Furthermore, when producing and wearing clothing corresponding to the corrected clothing model, the wearer's body shape needs to be changed to a shape corresponding to the body-corrected wearer model. Therefore, when outputting information for producing clothing corresponding to the corrected clothing model, the output unit 106 of this embodiment outputs information about body-correcting components for adjusting the wearer's body shape to that of the body-corrected wearer model. The information about the body-correcting components may include, for example, information about products to be used for body correction. The information about the body-correcting components may be stored in, for example, a database (not shown) included in the storage device 102. For example, the output unit 106 may identify the body-correcting components to be used based on the difference between the body-corrected wearer model and the wearer model, and output the information.

Image generation processing
Hereinafter, specific image generation processing for generating display elements (two-dimensional images) to be presented on the client device 200 used by the user in the assistance server 100 of this embodiment will be described using the flowchart in Fig. 11. The processing corresponding to the flowchart can be realized by the control unit 101 reading out a corresponding processing program stored in, for example, the storage device 102, expanding it in the memory 103, and executing it. This image generation processing will be described as being started when, for example, a display request for the provided screen 1000 or the provided screen 1010 or a display update request for the wearer model image is received from the client device 200 using the assistance service.

It is assumed that, prior to execution of this image generation process, a wearer model for the user (target wearer) using the client device 200 and a pre-correction clothing model for the costume of the motif character (target character) are constructed. In other words, it is assumed that the wearer information managed in the wearer DB 110 for the target wearer already contains the necessary information in body shape information 1302, skin color information 1303, and wearer model 1304. It is also assumed that the clothing model 1305 of the wearer information contains a pre-correction clothing model for the target character. In addition, in the image generation process of this embodiment, processing related to the use of the color adjustment function is omitted to clarify the characteristics of processing related to the use of the body shape correction function.

In S1101, the control unit 101 determines whether or not to perform body shape correction in accordance with the character's body shape information. The determination in this step is made by referencing the body shape correction flag. If the control unit 101 determines that body shape correction should be performed, it proceeds to S1102; if it determines that body shape correction should not be performed, it proceeds to S1106.

In S1102, the control unit 101 determines whether a body-corrected wearer model has been configured. The determination in this step is made based on whether a body-corrected wearer model is stored in the wearer model 1304 of the wearer information for the target wearer. If the control unit 101 determines that a body-corrected wearer model has been configured, it proceeds to S1105; if it determines that a body-corrected wearer model has not been configured, it proceeds to S1103.

In S1103, under the control of the control unit 101, the construction unit 104 constructs a body-corrected wearer model by transforming the wearer model of the target wearer based on the body shape information 1361 of the character information related to the target character. The constructed body-corrected wearer model is stored in the wearer model 1304 of the wearer information related to the target wearer.

In S1104, under the control of the control unit 101, the construction unit 104 constructs a corrected clothing model that matches the body-corrected wearer model constructed in S1103, based on the clothing information 1323 of the character information related to the target character. The constructed corrected clothing model is stored in the clothing model 1305 of the wearer information related to the target wearer.

At S1105, under the control of the control unit 101, the drawing unit 105 draws a body-corrected wearer model of the target wearer to which the corrected clothing model for the target character has been applied, and generates a display element (two-dimensional image).

On the other hand, if it is determined in S1101 that body shape correction will not be performed, the drawing unit 105, under the control of the control unit 101, draws a wearer model of the target wearer by applying the pre-correction clothing model for the target character in S1106, and generates display elements.

At S1107, the control unit 101 presents the generated display elements to the client device 200 associated with the target wearer, completing this image generation process.

In this way, a post-correction clothing model can be constructed that matches a body-corrected wearer model that reflects the body shape of the motif character, allowing the user to confirm the wearing comfort and appearance impression. Furthermore, the user can construct a preferred post-correction clothing model without actually wearing body-correction components and taking measurements, and can obtain information for producing clothing that corresponds to the post-correction clothing model and information about the body-correction components. Note that in this embodiment, a mode has been described in which display elements related to the wearer model image differ depending on whether or not an operation input has been made to the body correction menu 1004 on the provision screen 1000. However, the implementation of the present invention is not limited to this, and it is sufficient to present a wearer model to which a pre-correction clothing model has been applied and a body-corrected wearer model to which a post-correction clothing model has been applied in a manner that allows them to be compared; for example, both may be presented simultaneously.

[Modification 9]
In the above-described third embodiment, the wearer model is deformed to match the dimensional ratios between multiple body parts defined in the character's body shape information. However, this body shape correction is not possible for all body parts. For example, the sleeve length and arm length, or the length of the upper arm and forearm, are dimensions related to body parts whose dimensions cannot be physically changed (hereinafter referred to as invariant body parts). In other words, for such body parts of the wearer whose body shape cannot be changed, deformation to correspond to the character's body shape information cannot be applied to the wearer model when constructing a body shape corrected wearer model.

However, a character's clothing is designed to suit their body shape, and if a body-corrected wearer model is constructed without changing the dimensions of these invariant parts, the character's appearance may not be properly conveyed when the corrected clothing model is applied. More specifically, if the character's clothing information is transformed using the scaling factor used to construct the body-corrected wearer model to construct the corrected clothing model, the design of the clothing in the invariant parts may differ between the original character's clothing and the wearer model image applied to the body-corrected wearer model.

For example, if a character is assigned a three-quarter sleeve outfit as shown in Figure 12(a), the sleeve length of that outfit will depend on the length of the character's upper arms. However, because the upper arms are an invariant body part, if the ratio of the wearer's upper arm dimensions to their height is greater than the ratio of the dimensions of the same body part on the character, i.e., if the wearer's upper arms are longer than the character's, the sleeve length of the outfit may change as shown in Figure 12(b). As shown in the figure, if the wearer's upper arms are longer than the character's, simply constructing a corrected clothing model will result in a smaller proportion of the sleeve length to the upper arms, and as a result, the outfit will be produced with sleeves shorter than three-quarter sleeves.

Therefore, when constructing a corrected clothing model adapted to the body-corrected wearer model, the construction unit 104 further performs processing to adapt the dimensions of the invariant parts to the character design. This processing includes, for example, identifying the difference in dimensions of the invariant parts between the wearer and the character, based on the ratio of the dimension of the invariant part to height in the wearer's body type information and the ratio of the dimension of the invariant part to height in the character's body type information. The processing also includes changing the dimensions of the clothing corresponding to the invariant part in the character's clothing information based on the information about the difference in dimensions, and constructing a corrected clothing model based on the changed character's clothing information. In this way, the balance between the body type and clothing of the motif character can be reproduced for the wearer's body type, as shown in Figure 12(c).

For example, consider the case where the ratio of the wearer's upper arm (25 cm) to their height (160 cm) in the wearer's physique information is 25/160 ≒ 0.156, and the ratio of the character's upper arm (21 cm) to their height (144 cm) in the character's physique information is 21/144 ≒ 0.146. These ratios indicate that the wearer's upper arm is larger in proportion to their height (i.e., longer) than the character's upper arm. If the character's clothing sleeve length is set to 12.6 cm, covering up to 3/5 of the upper arm, the construction unit 104 changes the clothing sleeve length to 12.6 cm x 0.156/0.146 ≒ 13.5 cm, and constructs a corrected clothing model based on the value (15 cm) obtained by multiplying this by the scaling factor (160/144). Here, the sleeve length of 15 cm is 3/5 of the wearer's upper arm (25 cm), matching the balance of the sleeve length on the character's clothing upper arm.

By doing this, it is possible to create a clothing model that fits the wearer's body shape and ensures accurate reproduction of the appearance of the motif character.

In this modified example, we have illustrated a mode in which a corrected clothing model is constructed so that the balance between clothing and body shape for unchanging parts matches the character's design, but a customization function for each dimension of the clothing model may also be provided, allowing for changes to sleeve length, etc. that are not based on dimensional ratios. This allows the user to adjust the corrected clothing model to reflect their wishes, such as hiding a specific part of the body or providing more room for easier movement, rather than simply making it conform to the character's design.

[Modification 10]
In the above-described third embodiment and ninth modification, a form-corrected wearer model is constructed by scaling the character's body shape information to match the wearer's height and expressing the character's body shape at the scale of the wearer. However, the implementation of the present invention is not limited to this. For example, in a form in which the dimensions of a specific part of a character are widely known, the wearer model may be modified to match the dimensions of that part to construct a form-corrected wearer model.

For example, if a character has a distinctive chest size and the bust dimensions are published in a video or other work in which the character appears, the bust dimensions of the body-corrected wearer model may be configured to be the same as those of the character (published values). In other words, rather than transforming each part of the wearer model to the dimensions obtained by scaling the character's body type information to match the wearer's height, the dimensions of a specific distinctive part of the wearer model may be transformed to be the same as the dimensions of that part in the character's body type information. This makes it possible to create a body-corrected wearer model in which distinctive parts have the same shape as the character.

[Modification 11]
In the above-described third embodiment and the ninth and tenth modifications, the character information includes the body shape information of the character, and the construction unit 104 constructs a body shape correction wearer model by referring to the information. However, the present invention is not limited to this. The body shape information of the character may be acquired from a character image showing the corresponding character transmitted from the client device 200.

As explained in Variation 7, the character image may be, for example, an illustration depicting a character in a specific scene, or an image of a single frame of video in which a character appears. When acquiring a character's physique information from a character image, information for estimating the character's size (original dimensions) is required. In the support service of this variation, the user is prompted to input reference dimension information for estimating the character's original dimensions, such as the character's height, for the character image sent from the client device 200. The control unit 101 performs an analysis process on the character image to identify the area of the character's image and further identify the positions of specific joints and feature points for the character's image. The control unit 101 then sets the dimensions of the joints and feature points (such as the top of the head and heel in the case of height) corresponding to the reference dimension information to the input values, thereby identifying the scale of the character image, deriving the dimensions of each part based on the scale, and constructing the character's physique information.

By doing this, it is possible to obtain a character's body shape information from a character image and create a body-corrected wearer model without having to manage body shape information as character information. This method is also effective when it is necessary to create a clothing model for a character that is not registered in the character DB 130. In this case, it is also possible to obtain the character's clothing information from the obtained character image.

[Modification 12]
In the above-described embodiment and modified example, a 3D model of the clothing is stored in advance in the character information as the clothing information of the character, and the 3D model can be used to construct a clothing model for the character. In such an embodiment, a 3D model can be constructed in advance to make it easier to produce clothing corresponding to the clothing model, and appropriate patterns can be easily output according to the wearer's body type information.

However, preparing a 3D model of clothing that takes into account the ease of outputting information for creating the clothing requires more effort than creating a 3D model that simply reflects the appearance of the clothing. For this reason, it can be difficult to store in advance in character DB 130 3D models that make it easy to output information for creating clothing for a variety of characters.

Furthermore, in order to create clothing using patterns output based on clothing models, users need to have a certain level of sewing skill and be able to set aside a certain amount of time for production. In other words, for users who don't have the time or sewing skills, it is difficult to adopt a method of making all clothing by hand.

On the other hand, clothing that matches a character's outfit can also be created by remaking and combining ready-made products that resemble the character's outfit. This method reduces the time required for production and allows a wide range of users to obtain clothing based on their desired character.

Therefore, the support system of this modified example provides a function that allows the user to construct a clothing model corresponding to a character's clothing by combining 3D models of ready-made clothing products as clothing parts, even if the character information does not include a 3D model of each character's clothing. Therefore, the storage device 102 is provided with a clothing parts DB (not shown), which manages information on ready-made products that can be used to construct clothing. Then, when a motif character is selected on the provided screen, the user can select clothing parts corresponding to the character from the group of clothing parts managed in the clothing parts DB, for example, while referring to the character image on the provided screen. Once a clothing part is selected, the construction unit 104 can use the 3D model of the clothing part to resize it to fit the wearer model and construct a clothing model. In other words, acquiring information on the selected clothing parts in this modified example corresponds to acquiring the character's clothing information.

In order to make it easier for the user to select costume parts, color scheme information and shape information about the character's costume may be acquired, and a group of costume parts with similar shapes and color schemes may be extracted and presented for selection. In this case, the color scheme information and shape information may be managed in the characteristic DB 120 as character information, or may be acquired by analyzing the character image.

In addition, in implementing the present invention, clothing parts are not limited to ready-made products, but may be clothing templates for conventional clothing with known shapes and manufacturing methods. In this case, pattern information and the like can be easily obtained for the clothing templates, allowing for customization beyond the scope of remaking ready-made products. Specifically, by allowing the user to select a clothing template with a shape that corresponds to the character's clothing and allowing settings such as color scheme, pattern, and various dimensions for that clothing template, a clothing model with the user's desired appearance can be easily constructed. For clothing models constructed in this way, the output unit 106 can output information for producing clothing based on information such as the pattern of the clothing template that served as the base.

Furthermore, such clothing parts may include body shape correction components, and may be configured to be able to deform and present a wearer model rather than a clothing model depending on the selection of the body shape correction component.

Furthermore, the selection of costume parts is not limited to being performed by the user; for example, the control unit 101 may analyze the character image and select the corresponding costume parts.

[Modification 13]
In the above-described embodiment and modified examples, the wearer model and clothing model constructed by the construction unit 104 are described as 3D models, but the implementation of the present invention is not limited to this. The wearer model and clothing model constructed by the construction unit 104 may be in the form of, for example, two-dimensional images related to three-view drawings.

[Modification 14]
In the above-described embodiment and modified example, the assistance service is provided via a browser, and therefore it has been described that various models are drawn in the assistance server 100 and the drawn results are transmitted to the client device 200. However, the present invention is not limited to this. For example, a wearer model and a clothing model constructed in the assistance server 100 may be provided to the client device 200, and the drawing may be performed in the client device 200. Furthermore, the construction, drawing, and display of the models may be performed in a single device.

[Other embodiments]
The present invention can also be realized by supplying a program that realizes one or more of the functions of the above-described embodiments to a system or device via a network or a storage medium, and having one or more processors in the computer of the system or device read and execute the program.The present invention can also be realized by a circuit (e.g., an ASIC) that realizes one or more of the functions.

The invention is not limited to the above-described embodiments, and various modifications and variations are possible without departing from the spirit and scope of the invention. Therefore, the following claims are appended to clarify the scope of the invention.

100: Support Server, 101: Control Unit, 102: Storage Device, 103: Memory, 104: Configuration Unit, 105: Drawing Unit, 106: Output Unit, 107: Communication Unit, 110: Wearer DB, 120: Characteristics DB, 130: Character DB, 140: Adjustment DB

Claims (17)

An information processing device having a presentation means for applying a clothing model configured based on a costume of a character as a motif to a wearer model and presenting the clothing model,
a first acquisition means for acquiring body type information of a wearer;
a first configuration means for configuring a first wearer model based on the body type information of the wearer;
a second acquisition means for acquiring body type information and clothing information of the character;
a transformation means for transforming the first wearer model based on the body type information of the character to form a second wearer model;
a second configuration means for configuring a first clothing model that fits the second wearer model based on clothing information of the character;
and
The information processing apparatus is characterized in that the presentation means presents the second wearer model to which the first clothing model is applied. the character's body type information includes information on the dimensions of a plurality of body parts that constitute the character;
2. The information processing device according to claim 1, wherein the transformation performed by the transformation means includes a first transformation that sets the dimensional ratio between multiple parts constituting the first wearer model to the dimensional ratio between the same parts of the character. The information processing device of claim 2, characterized in that the transformation performed by the transformation means includes a second transformation that makes the dimensions of at least some of the multiple parts constituting the first wearer model the same as the dimensions of the same part of the character. The parts constituting the first wearer model include an invariable part whose dimensions cannot be changed,
the transformation means constructs the second wearer model without transforming the first wearer model based on the body type information of the character with respect to the invariant parts;
4. The information processing device according to claim 1, wherein the second configuration means configures the first clothing model by changing the dimensions of the clothing corresponding to the invariant parts of the clothing information of the character based on the body type information of the wearer and the body type information of the character. The method further includes a third acquisition means for acquiring a character image showing the character and information on reference dimensions for estimating the original dimensions of the character,
5. The information processing apparatus according to claim 1, wherein the second acquisition means acquires the body type information of the character based on the character image and the information on the reference dimensions. The information processing device described in claim 5, characterized in that the second acquisition means further acquires costume information of the character based on the character image. a first selection means for accepting a selection of the character from a plurality of types of characters;
a storage means for storing body type information relating to each of the plurality of types of characters;
and
5. The information processing apparatus according to claim 1, wherein the second acquisition means acquires, from the storage means, the body type information of the character whose selection has been accepted by the first selection means. the storage means further stores costume information relating to each of the plurality of types of characters;
8. The information processing apparatus according to claim 7, wherein the second acquisition means further acquires, from the storage means, costume information of the character selected by the first selection means. the storage means stores a plurality of types of costume information for each of the plurality of types of characters;
the information processing device further includes second selection means for accepting a selection of one of the plurality of types of costume information related to the character, for the character whose selection has been accepted by the first selection means;
9. The information processing apparatus according to claim 8, wherein the second acquisition means further acquires, as the costume information of the character, the one type of costume information selected by the second selection means. the storage means further stores, for each of the plurality of types of characters, a group of costume parts associated with the character;
the information processing device further comprises third selecting means for accepting a selection of clothing parts to be reflected in the first clothing model from the clothing parts group associated with the character, for the character whose selection has been accepted by the first selecting means;
8. The information processing apparatus according to claim 7, wherein the second acquisition means further acquires information on the costume parts selected by the third selection means as costume information for the character. a third configuration means for configuring a second clothing model that fits the first wearer model based on the clothing information of the character;
a switching means for accepting switching of the wearer model to be presented by the presentation means;
and
11. The information processing device according to claim 1, wherein the presenting means, in response to a switch being accepted by the switching means, switches between presenting the second wearer model to which the first clothing model is applied and presenting the first wearer model to which the second clothing model is applied. An information processing device according to any one of claims 1 to 11, characterized in that the wearer model and the clothing model include 3D models. An information processing device according to any one of claims 1 to 12, characterized in that the wearer model and the clothing model include two-dimensional images. An information processing device according to any one of claims 1 to 13, further comprising a first output means for outputting information for producing clothing corresponding to the first clothing model. An information processing device according to any one of claims 1 to 14, further comprising a second output means for outputting information about a body shape correction component for adjusting the body shape of the wearer to that of the second wearer model. 1. A control method for an information processing device having a presentation means for applying a clothing model configured based on a costume of a character that is a motif to a wearer model and presenting the applied clothing model,
a first acquisition step of acquiring body type information of a wearer;
a first constructing step of constructing a first wearer model based on the body type information of the wearer;
a second acquisition step of acquiring body type information and clothing information of the character;
a transformation step of transforming the first wearer model based on body shape information of the character to construct a second wearer model;
a second construction step of constructing a first clothing model that fits the second wearer model based on clothing information of the character;
causing the presentation means to present the second wearer model to which the first clothing model is applied;
A control method comprising: a computer having a presentation means for applying a clothing model based on a costume of a character as a motif to a wearer model and presenting the clothing model;
A process of acquiring body shape information of a wearer;
A process of constructing a first wearer model based on the body type information of the wearer;
A process of acquiring body type information and clothing information of the character;
a process of constructing a second wearer model by transforming the first wearer model based on body type information of the character;
constructing a first clothing model that fits the second wearer model based on clothing information of the character;
a process of causing the presentation means to present the second wearer model to which the first clothing model is applied;
A program that executes the following.