JP5413674B2 - Fitting system, fitting image creation method and program - Google Patents

Description

  The present invention relates to a technique for creating a try-on image that virtually represents a person wearing a costume.

  Conventionally, by creating a try-on image that virtually represents the customer wearing the costume and displaying it on the screen, the customer wears the costume without trying on the costume. A technique for confirming this is known.

JP 2008-210223 A JP 2009-246638 A

  However, in the conventional technology, since a try-on image is created by simply overlaying or stitching an image of a customer's face on an image of a costume, a realistic try-on image cannot be created. was there.

  The present invention has been made in view of the above problems, and an object thereof is to create a fitting image that is closer to reality.

  In order to solve the above problems, the invention of claim 1 is a try-on system that creates a try-on image that virtually represents a try-on state, and images a state in which a model imitating a user is not wearing a costume. First acquisition means for acquiring a model image, second acquisition means for acquiring a costume image obtained by imaging a state in which a costume is attached to the model, and an exposed portion of the model in the costume image acquired by the second acquisition means Computing means for computing a correction value based on the first partial image corresponding to the second partial image corresponding to the portion corresponding to the first partial image in the model image obtained by the first obtaining means; A third acquisition unit that captures a user and acquires a user image; a costume image acquired by the second acquisition unit; a user image acquired by the third acquisition unit; Based on the correction value, characterized in that it comprises an image generating means for generating a fitting image the user has a virtual representation of the state of mounting the costume.

  Further, the invention of claim 2 is a method for creating a try-on image that virtually represents a try-on state, wherein a model imitating a user is photographed when a costume is not worn and a model image is obtained. A step of acquiring, a step of acquiring a costume image by imaging a state in which a costume is attached to the model, a first partial image corresponding to an exposed portion of the model in the costume image, and the first in the model image A step of calculating a correction value based on a second partial image corresponding to a portion corresponding to the partial image, a step of capturing a user and acquiring a user image, the costume image, the user image, and the correction value And a step of creating a try-on image in which the user virtually represents the state of wearing the costume.

  Further, the invention of claim 3 is a program that can be executed by a computer, and the execution of the program by the computer is a model in which a model imitating the user is not wearing a costume. First exposure means for acquiring an image, second acquisition means for acquiring a costume image obtained by imaging a state in which a costume is attached to the model, and an exposed portion of the model in the costume image acquired by the second acquisition means A computing means for computing a correction value based on a corresponding first partial image and a second partial image corresponding to a portion corresponding to the first partial image in the model image obtained by the first obtaining means; A third acquisition unit that captures a user image and acquires a user image, a costume image acquired by the second acquisition unit, and a user acquired by the third acquisition unit An image creation means for creating a try-on image that virtually represents a state in which the user wears the costume based on the image and the correction value obtained by the calculation means; Features.

  The invention according to claims 1 to 3 obtains a model image obtained by imaging a state in which a model imitating a user is not wearing a costume, obtains a costume image obtained by imaging a state in which the model is worn. A correction value is calculated based on the first partial image corresponding to the exposed portion of the model in the acquired costume image and the second partial image corresponding to the portion corresponding to the first partial image in the acquired model image, A user image is acquired by capturing a user, and based on the acquired costume image, the acquired user image, and the obtained correction value, a try-on image that virtually represents a state in which the user is wearing the costume By creating, a more realistic fitting image can be created.

It is a figure which shows the try-on system which concerns on this invention. It is a figure which shows the functional block of a fitting system with the flow of data. It is a flowchart which shows the fitting image creation method which concerns on this invention.

  DESCRIPTION OF EXEMPLARY EMBODIMENTS Hereinafter, preferred embodiments of the invention will be described in detail with reference to the accompanying drawings.

<1. Embodiment>
FIG. 1 is a diagram showing a fitting system 1 according to the present invention.

  The fitting system 1 includes a CPU 10 that calculates various data, a RAM 11 that is used as a working area of the CPU 10, a ROM 12 that stores a program 120 that is executed by the CPU 10, and a hard disk 13 that stores various data. Thereby, the fitting system 1 has a function as a general computer that executes the program 120.

  Furthermore, as shown in FIG. 1, the try-on system 1 includes an operation unit 14, a display unit 15, an imaging unit 16, and an illumination unit 17.

  The operation unit 14 is operated by an operator of the fitting system 1 and is used to input various data to the fitting system 1. The operation unit 14 includes a keyboard, a mouse, various buttons, and the like. Of course, the operation unit 14 is not limited to these, and any device having a function of inputting various data may be used. For example, the operation unit 14 functions as a shutter button that instructs the imaging unit 16 to perform imaging.

  The display unit 15 is a liquid crystal display and has a function of displaying various data on a screen. In particular, the display unit 15 has a function of displaying a try-on image 136 (see FIG. 2 described later) on the screen and presenting it to the customer. The customer can confirm the actual wearing state of the costume without trying on the costume by confirming the fitting image 136 displayed on the display unit 15.

  The imaging unit 16 is configured as a so-called general digital camera, and has a function of acquiring an image obtained by imaging a subject using various optical lenses, a photoelectric conversion element such as a CCD, or the like. The image acquired by the imaging unit 16 is stored in the hard disk 13. Note that the imaging unit 16 in the present embodiment has a function of acquiring a color still image by imaging.

  The illumination unit 17 is a light source that emits illumination light, and corresponds to, for example, a lamp, a fluorescent lamp, a white lamp, an LED, or a light bulb that simulates sunlight. The illuminating unit 17 illuminates the subject imaged by the imaging unit 16 in substantially the same illumination state in imaging by the imaging unit 16.

  FIG. 2 is a diagram showing functional blocks of the fitting system 1 together with a data flow. The image extraction unit 100, the calculation unit 101, and the image creation unit 102 illustrated in FIG. 2 are functional blocks that are realized by the CPU 10 executing the program 120.

  The image extraction unit 100 has a function of extracting, as the first partial image 133, an image area corresponding to the exposed portion of the model imitating the user in the costume image 131.

  In addition, the image extraction unit 100 identifies the model image 130 corresponding to the costume image 131 from which the first partial image 133 is extracted, and the first part extracted from the costume image 131 in the model image 130. An image region corresponding to a portion corresponding to the image 133 is extracted as the second partial image 134.

The calculation unit 101 calculates a correction value based on the first partial image 133 and the second partial image 134 extracted by the image extraction unit 100 and creates correction value data 135. That is, the arithmetic unit 101 includes a first partial image 133 corresponding to the exposed portions of the model in the imaging section 16 costume image 131 acquired by, the first partial image 133 in the model image 130 acquired by the imaging unit 16 And a function of calculating a correction value based on the second partial image 134 corresponding to the portion corresponding to.

  The image creating unit 102 has a function of creating a try-on image 136 that virtually represents a state in which the user wears a costume based on the costume image 131, the user image 132, and the correction value data 135.

  The above is the description of the configuration and functions of the fitting system 1. Next, a fitting image creation method realized using the fitting system 1 will be described.

  FIG. 3 is a flowchart showing a fitting image creation method according to the present invention. When the imaging unit 16 performs imaging, the illumination unit 17 illuminates in substantially the same illumination state. Specifically, the illuminance and the like by the illumination unit 17 are adjusted so as to be the same at the time of each imaging.

  First, the imaging unit 16 captures a state where the mannequin (model imitating the user) is not wearing a costume and acquires the model image 130 (step S1). Usually, if only one model image 130 is created for one mannequin, a plurality of costume images 131 using the mannequin are sufficient.

  Next, the imaging unit 16 captures the state where the mannequin is wearing the costume and acquires the costume image 131 (step S2). At this time, the mannequin model image 130 used when capturing the costume image 131 is associated with the costume image 131 stored in the hard disk 13. The costume image 131 is also given an identifier (for example, a product code) that identifies the captured costume. When the store provides a plurality of costumes, a costume image 131 is created for each costume and stored in the hard disk 13.

  When the costume image 131 is created, the image extraction unit 100 extracts an image area corresponding to the exposed part of the mannequin in the costume image 131 as the first partial image 133. Thereby, for example, from a costume image 131 obtained by imaging a mannequin wearing a “T-shirt” as a costume, an image region corresponding to the face part (exposed part) of the mannequin is extracted as the first partial image 133. It should be noted that it is not necessary to extract the image area corresponding to all exposed portions of the mannequin as the first partial image 133, and the extraction is limited to a portion having a large influence (for example, a face portion) in the fitting image 136. May be.

  Furthermore, the image extraction unit 100 sets, as the second partial image 134, an image region corresponding to a part corresponding to the first partial image 133 extracted from the costume image 131 in the model image 130 associated with the costume image 131. Extract. That is, in the above example, an image region corresponding to a part of the mannequin face (a part corresponding to the first partial image 133) from a model image 130 (an image using a common mannequin) corresponding to the costume image 131 is obtained. Extracted as the second partial image 134.

  Next, the calculation unit 101 calculates a correction value based on the first partial image 133 and the second partial image 134 extracted by the image extraction unit 100 (step S3), and generates correction value data 135.

  The correction value calculated by the calculation unit 101 at this time is a value indicating a change in the exposed portion of the mannequin due to wearing the costume imaged on the costume image 131.

  The calculation unit 101 according to the present embodiment uses the difference value between the first partial image 133 and the second partial image 134 as a correction value. For example, the light beam from the difference value to the exposed portion when the costume is further worn The amount of change may be obtained and used as a correction value.

  Further, the calculation unit 101 stores the created correction value data 135 in the hard disk 13 in association with the costume image 131 from which the correction value is calculated. In this way, in the try-on system 1, every time the costume image 131 is created, the correction value data 135 corresponding to the costume image 131 is created.

  It should be noted that the costume image 131 and the model image 130 are preferably taken in advance and stored in the hard disk 13 together with the correction value data 135 when the sale of costumes is started. That is, before the customer (person) visits the store, it is preferable to prepare the costume image 131 and the correction value data 135 in advance for each costume that can be a try-on target.

  When a customer who wants to use the fitting system 1 (that is, a user of the fitting system 1) visits the store, the imaging unit 16 captures the customer and acquires a user image 132 (step S4). The user image 132 may be a full-body image of the customer, or may be a face image obtained by capturing only the customer's face as the part of the user that most affects the fitting image 136.

  Next, when the operation unit 14 is operated and a costume desired by the customer is specified, a costume image 131 associated with the costume, a user image 132, and correction value data 135 associated with the costume image 131 Based on the above, the image creation unit 102 creates a try-on image 136 (step S5).

  More specifically, the value of each pixel in the image area corresponding to the exposed portion of the user in the user image 132 (the portion corresponding to the first partial image 133 and the second partial image 134) is a correction value indicated in the correction value data 135. The image is combined with the costume image 131 to create a try-on image 136. Alternatively, after the costume image 131 and the user image 132 are synthesized using a conventional technique, the fitting image 136 may be generated by performing correction using the correction value data 135.

  When the fitting image 136 is created by the image creating unit 102, the display unit 15 displays the fitting image 136 created in step S5 on the screen (step S6). The fitting image 136 may be stored in the hard disk 13.

  In general, the appearance of the wearer's face (exposed part) also changes depending on the color of the costume to be worn. This is due to the influence of reflected light from the costume. In the conventional technique, since the user's face and the costume are separately captured and simply connected and synthesized, the user's face when the costume is worn cannot be expressed sufficiently.

  In particular, “face-to-face (try-on)” performed when tailoring a kimono or the like is not a confirmation of size or comfort (the kimono has not been completed at that time). The main purpose of “face-to-face” is to check the appearance (face-up) on the face by the fabric (fabric). If this cannot be reproduced, the meaning of “face-to-face” is halved.

  However, in the try-on system 1, the influence when the costume is worn is created as the correction value data 135 on the basis of the mannequin used when imaging the costume, and the try-on image 136 is created based on this. Thereby, the state of the user when wearing the costume can be reproduced in a state closer to reality.

  As described above, the try-on system 1 is a system that creates a try-on image 136 that virtually represents a state in which a user wears a costume, and the image capturing unit 16 captures the state in which the mannequin is worn. An image 131, a model image 130 in which the mannequin is not wearing a costume, and a user image 132 in which the user is imaged are acquired, and a first partial image 133 corresponding to an exposed portion of the mannequin in the costume image 131; A calculation unit for calculating a correction value (correction value data 135) for the second partial image 134 corresponding to a portion corresponding to the first partial image 133 in the model image 130, a costume image 131, a user image 132, and a correction value; On the basis of the garment, by creating a try-on image 136 that virtually represents the state in which the user is wearing the costume, It is possible to create a fitting image 136 in consideration of the glare or the like. Therefore, a more realistic fitting image 136 can be created.

<2. Modification>
Although the embodiments of the present invention have been described above, the present invention is not limited to the above embodiments, and various modifications can be made.

  For example, the program 120 has been described as being stored in the ROM 12, but may be stored in the hard disk 13 and loaded into the RAM 11 as necessary. Alternatively, the program may be executed after being recorded on a recording medium such as a CD-ROM and read by a CD-ROM drive or the like.

  The functional blocks shown in the above embodiment have been described as being mainly realized by software (program 120). However, all or some of them may be realized by a dedicated logic circuit (hardware). Good.

  Moreover, the processing order and the processing content shown in the said embodiment are not restricted to what was shown in the said embodiment. That is, as long as similar functions and effects can be obtained, the processing order and processing contents may be changed as appropriate. For example, the order of step S1 for imaging a mannequin and step S2 for imaging a costume may be interchanged.

  The fitting system 1 may be realized in a distributed manner by a plurality of devices. For example, an imaging device that only images a subject, a computer that creates a try-on image 136, and a browsing terminal device that displays the try-on image 136 may be realized by separate devices.

  Moreover, although the fitting system 1 demonstrated in the example which produces the fitting image 136 which made the customer (person) the user, the user may be an animal (pets, such as a dog and a cat).

  Also, the costume image 131 used when the correction value data 135 is created and the costume image 131 used when creating the fitting image 136 may not be completely the same image. For example, the costume image 131 used when the correction value data 135 is created may be acquired by attaching an unfinished costume to a model and imaging the model. That is, when the costume image 131 is photographed for the creation of the correction value data 135, the costume attached to the model can reproduce the appearance of the finished costume (cloth such as cloth, paper as a sample, etc.) including. In that case, when the costume is completed, a costume image 131 for creating a try-on image 136 may be captured again.

1 Try-on system 10 CPU
DESCRIPTION OF SYMBOLS 100 Image extraction part 101 Operation part 102 Image preparation part 11 RAM
12 ROM
120 program 13 hard disk 130 model image 131 costume image 132 user image 133 first partial image 134 second partial image 135 correction value data 136 fitting image 14 operation unit 15 display unit 16 imaging unit 17 illumination unit

Claims (3)

A try-on system that creates a try-on image that virtually represents a try-on state,
First acquisition means for acquiring a model image in which a model imitating a user is not wearing a costume;
Second acquisition means for acquiring a costume image obtained by imaging a state in which a costume is mounted on the model;
The first partial image corresponding to the exposed portion of the model in the costume image acquired by the second acquisition means, and the portion corresponding to the first partial image in the model image acquired by the first acquisition means. Computing means for computing a correction value based on the second partial image;
Third acquisition means for capturing a user and acquiring a user image;
Based on the costume image acquired by the second acquisition means, the user image acquired by the third acquisition means, and the correction value obtained by the calculation means, the state in which the user wears the costume is virtually Image creation means for creating a try-on image expressed visually,
A fitting system characterized by comprising: A fitting image creation method for creating a fitting image that virtually represents a fitting state,
Capturing a model image of a model imitating the user without wearing a costume; and
Capturing a costume image by imaging a state in which a costume is mounted on the model; and
Calculating a correction value based on a first partial image corresponding to an exposed portion of the model in the costume image and a second partial image corresponding to a portion corresponding to the first partial image in the model image;
Capturing a user and obtaining a user image;
Based on the costume image, the user image, and the correction value, creating a try-on image that virtually represents a state in which the user wears the costume;
A method for creating a try-on image. A computer-executable program, wherein the execution of the program by the computer
First acquisition means for acquiring a model image in which a model imitating a user is not wearing a costume;
Second acquisition means for acquiring a costume image obtained by imaging a state in which a costume is mounted on the model;
The first partial image corresponding to the exposed portion of the model in the costume image acquired by the second acquisition means, and the portion corresponding to the first partial image in the model image acquired by the first acquisition means. Computing means for computing a correction value based on the second partial image;
Third acquisition means for capturing a user and acquiring a user image;
Based on the costume image acquired by the second acquisition means, the user image acquired by the third acquisition means, and the correction value obtained by the calculation means, the state in which the user wears the costume is virtually Image creation means for creating a try-on image expressed visually,
A program characterized by functioning as a fitting system with

Images