JP5392575B2 - Image editing apparatus and method, and program - Google Patents

Description

  The present invention relates to an image editing apparatus and method, and a program, and more particularly, to an image editing apparatus and method, and a program capable of obtaining a three-dimensional finished image.

  Conventionally, a user (subject) is photographed, and a graffiti editing process is performed in which a prepared image is combined with the obtained photographed image or a character or a line drawing is superimposed, printed on sticker paper, and a photo sticker There is a photographic seal machine provided to users.

  This photo sticker is installed, for example, in an entertainment (game) facility such as a game center, and provides services mainly to high school girls and female junior high school students for a fee. Users can not only enjoy creating photo stickers as a game, but also cut out photo stickers with edited images printed in various sizes and paste them on their belongings. doing.

  The game for creating a photo sticker is performed by shooting a subject, editing a graffiti on the shot image, and outputting the edited image to a photo sticker. The user plays this series of processes within the time limit, and receives a photo sticker created as a product. Therefore, in order to improve user satisfaction, it is important to improve the fun of the photo sticker creation work as well as to improve the quality of the photo sticker.

  In a photo sticker that provides such a game for creating a photo sticker, a decorative image such as an aura image is synthesized around the subject (outside) of the photographed image, or the contour portion of the subject is shaded. Image processing is performed.

  In particular, the difference between the reduced mask image obtained by reducing the subject mask image obtained by masking the subject area in the photographed image and the enlarged mask image obtained by enlarging the subject mask image is calculated, and the difference area corresponding to the difference in the photographed image is calculated. There is a photographic seal machine that performs image processing such as a glow effect and a blurring process (see Patent Document 1).

  As described above, by performing image processing on the boundary portion between the subject area and the background area in the photographed image, the photographic sticker provided to the user has an interesting finish or a natural and beautiful finish.

JP 2006-60719 A

  However, in the above-described image processing, it is difficult to give a real sense of depth between the subject and the background, resulting in a flat finish.

  The present invention has been made in view of such a situation, and makes it possible to obtain a three-dimensional finished image.

An image editing apparatus according to an aspect of the present invention is an image editing apparatus that captures an image of a user as a subject and outputs the obtained image. An image capturing unit that captures an image of the user as an object and obtains a captured image; In the photographed image, a detecting means for detecting a skin area that is the skin area of the subject, a blurring process for blurring the photographed image to obtain a blurred photographed image, and a color of the blurred photographed image. A color adjustment unit that obtains a color-adjusted captured image by adjusting, a mask image generating unit that generates a mask image that masks an area other than the subject area in the captured image, and a blurring process that blurs the mask image. , Mask image blur processing means for obtaining a blur mask image, pixel values of corresponding pixels in the binarized mask image and the blur mask image On the other hand, by using exclusive OR, the area having a width with respect to the boundary between the subject area that is the subject area and the area other than the subject area, and the pixel density around the boundary is increased. Setting means for setting different boundary areas; Extracting means for extracting a boundary area image of a part corresponding to the boundary area from the color-adjusted captured image; the extracted boundary area image; and the captured image And the photographic image blurring processing unit performs a blurring process with a low degree of blurring on the skin area of the photographic image.

In this image editing apparatus, the photographing unit is configured by, for example, a photographing control unit, the detecting unit is configured by , for example, a skin region detecting unit, and the captured image blurring processing unit is configured by, for example, a composite image blurring processing unit. The color adjustment unit is configured by, for example, a color adjustment unit, the mask image generation unit is configured by , for example, a mask image generation unit, and the mask image blurring processing unit is configured by, for example, a mask image blurring processing unit. The means is configured by, for example, a boundary region setting unit, the extraction unit is configured by, for example, an extraction unit, and the synthesis unit is configured by, for example, a synthesis unit.

In the image editing apparatus of the present invention, a user is photographed as a subject to obtain a photographed image, and in the photographed image, a skin region that is a skin region of the subject is detected, and blur processing is performed to blur the photographed image, A blurred photographed image is obtained, and the color of the blurred photographed image is adjusted to obtain a color-adjusted photographed image. In the photographed image, a mask image that masks areas other than the subject area is generated, and the masked image is blurred. Processing, a blurred mask image is obtained, and in the binarized mask image and the blurred mask image, an exclusive OR is used for the pixel values of the corresponding pixels, so that the subject area that is the subject area And an area that has a width relative to the boundary with the area other than the subject area, and a boundary area that sets the pixel density to be different around the boundary is set. From the image, the boundary region image of a portion corresponding to the boundary area is extracted, and the extracted boundary region image, and the captured image are synthesized. A blur process with a low degree of blur is performed on the skin area of the photographed image.

As a result, it is possible to obtain an image with a natural three-dimensional finish at the subject's face or the boundary between the hand and the background .

  The color adjusting means can adjust either one or both of brightness and saturation of the captured image.

  As a result, it is possible to obtain a three-dimensional composite image in which the subject smoothly harmonizes with the background, and a three-dimensional composite image in which the subject stands out.

  The color adjusting unit may further adjust the color of the boundary region image extracted by the extracting unit.

  The color adjusting means can adjust the color so that the boundary area image differs between the inside and outside of the boundary between the subject area and the area other than the subject area.

  Thereby, for example, it is possible to obtain a three-dimensional composite image in which the subject smoothly harmonizes with the background, or a three-dimensional composite image in which the subject stands out.

  The setting means can variably adjust the width of the boundary region.

  This makes it possible to provide an interesting depth feeling between the subject and the background in the composite image having a three-dimensional finish.

  The image editing apparatus further includes an editing unit that edits the synthesized image synthesized by the synthesizing unit based on an editing input by a user, and the editing unit has an editing image used for editing input, The editing image corresponding to the color adjustment by the color adjusting means can be selected by the user.

  The editing means of this image editing apparatus is constituted by an editing processing unit, for example.

  Thereby, for example, a finished image used for the cover of a fashion magazine can be obtained.

An image editing method according to one aspect of the present invention is an image editing method of an image editing apparatus that captures a user as a subject and outputs the obtained image, and captures the user as a subject to obtain a captured image. A detection step for detecting a skin region that is a skin region of the subject in the photographed image, a photographed image blur processing step for performing a blurring process for blurring the photographed image to obtain a blur photographed image, and the blur photographing by adjusting the color of an image, blurring the color adjustment to obtain a color adjustment captured image in the captured image, a mask image generation step of generating a mask image obtained by masking an area other than the subject region, the mask image A mask image blur processing step for performing blur processing to obtain a blur mask image, the binarized mask image and the blur mask In the image, the exclusive OR is used for the pixel values of the corresponding pixels, so that an area having a width with respect to the boundary between the subject area that is the subject area and the area other than the subject area is used. A setting step for setting a boundary region that makes the density of pixels different from each other around the boundary, an extraction step for extracting a boundary region image corresponding to the boundary region from the color-adjusted photographed image, and extraction A combination step of combining the boundary area image and the photographed image, and the photographed image blurring processing step performs a blurring process with a low degree of blurring on the skin region of the photographed image.

In the image editing method of the present invention, a user is photographed as a subject to obtain a photographed image, and in the photographed image, a skin region that is a skin region of the subject is detected, and blur processing is performed to blur the photographed image, A blurred photographed image is obtained, and the color of the blurred photographed image is adjusted to obtain a color-adjusted photographed image. In the photographed image, a mask image that masks areas other than the subject area is generated, and the masked image is blurred. Processing, a blurred mask image is obtained, and in the binarized mask image and the blurred mask image, an exclusive OR is used for the pixel values of the corresponding pixels, so that the subject area that is the subject area And an area that has a width relative to the boundary with the area other than the subject area, and a boundary area that sets the pixel density to be different around the boundary is set. From the image, the boundary region image of a portion corresponding to the boundary area is extracted, and the extracted boundary region image, and the captured image are synthesized. A blur process with a low degree of blur is performed on the skin area of the photographed image.

A program according to an aspect of the present invention is a program that causes a computer to execute a process of photographing a user as a subject and outputting the obtained image. The photograph of the user as a subject is captured. A capturing step, a detection step of detecting a skin region that is a skin region of the subject in the captured image, a blurring process for blurring the captured image, and a captured image blurring process step for obtaining a blurred captured image; by adjusting the color blur the captured image, a color adjusting step of obtaining a color adjustment captured image in the captured image, a mask image generation step of generating a mask image obtained by masking an area other than the subject region, the mask image A mask image blurring processing step for performing blurring processing for blurring and obtaining a blurring mask image, and the binarized matrix In the image and the blur mask image, by using exclusive OR for the pixel value of the corresponding pixel, the width of the boundary between the subject region that is the subject region and the region other than the subject region is increased. A setting step for setting a boundary region that has different pixel densities around the boundary, and extraction for extracting a boundary region image corresponding to the boundary region from the color-adjusted captured image A computer that executes a process including a step and a combining step of combining the extracted boundary region image and the captured image, and the captured image blurring processing step is performed on the skin region of the captured image. Apply a blur process with a low degree of blur.

  This program is recorded on a predetermined recording medium, read by a drive, for example, and installed in the photo sticker creating apparatus. Recording media include magnetic disks made of floppy (registered trademark) disks, optical disks made of CD-ROM (Compact Disc Read Only Memory), DVD-ROM (Digital Versatile Disc), MD (Mini Disc) (registered trademark), etc. And a removable medium such as a semiconductor memory.

  According to the present invention, a three-dimensional finished image can be obtained.

It is a perspective view which shows the structural example of the photograph sticker production apparatus to which this invention is applied. It is the perspective view which looked at the photo sticker production apparatus of FIG. 1 from another angle. It is a figure explaining the user's space movement in a photograph sticker creation apparatus. It is a figure which shows the structural example of the front of the front unit of an imaging | photography unit. It is a figure which shows the structural example of the side surface of an edit unit. It is a figure which shows the structural example of the other side of an edit unit. It is a block diagram which shows the example of an internal structure of a photograph sticker production apparatus. It is a functional block diagram which shows the detailed structural example of the control part of FIG. It is a functional block diagram which shows the detailed structural example of an imaging | photography process part. It is a functional block diagram which shows the detailed structural example of a boundary area edit process part. It is a flowchart explaining the example of the flow of photograph sticker creation game processing. It is a flowchart explaining the example of the flow of an imaging | photography process. It is a flowchart explaining the example of the flow of a boundary area | region edit process. It is a figure explaining the example of the flow of a boundary area | region edit process. It is a figure explaining the example of the flow of a boundary area | region edit process. It is a figure explaining the brightness in a boundary region. It is a figure explaining the brightness in a boundary region. It is a figure explaining adjustment of the width of a boundary field. It is a functional block diagram which shows the other structural example of a boundary area edit process part. It is a flowchart explaining the example of the flow of a synthetic | combination image blurring process.

  FIG. 1 is a perspective view showing a configuration example of a photographic sticker creating apparatus 1.

  The photo sticker creating apparatus 1 is a game machine (image processing apparatus) that allows a user to perform operations such as shooting and editing as a game and receives a price from the user instead of providing a shot image or an edited image. The photo sticker creating apparatus 1 is installed in a store such as a game center. There may be one user or a plurality of users.

  In the photo sticker creation game provided by the photo sticker creation device 1, the user enters a price, takes a picture of himself as a subject, selects an image to be edited from the shot images obtained by the shooting, By editing the image to be edited using an editing function for synthesizing a frame image as a background or foreground, a handwritten line drawing, or a stamp image, the photographed image becomes a colorful image. After the game, the user receives a sticker sheet on which the edited image is printed.

  As shown in FIG. 1, the housing 10 of the photo sticker creating apparatus 1 mainly includes a photographing unit 12, an editing unit 13, a ceiling strobe unit 14, and a background curtain unit 15.

  The photographing unit 12 is a unit having a function of photographing a user as a subject. Photographing is performed in a photographing space inside the photographing unit 12. The photographing unit 12 is roughly divided into a front unit 12A and a rear unit 12B.

  The front unit 12A is a unit on the front side of the shooting space, and performs processing related to shooting and receives operations by the user. An external monitor 16, a speaker 17, and touch pens 18a and 18b are provided on the side surface of the front unit 12A. A coin slot 55 is provided below the external monitor 16. The rear unit 12B is a wall-like unit on the rear side of the photographing space.

  The editing unit 13 is a unit provided with a configuration for a user to edit a captured image. A configuration for performing editing or the like is provided on each of the two surfaces of the editing unit 13 so that two sets of users can perform editing work simultaneously. The photo sticker creating apparatus 1 can execute a photo sticker creating game for a certain user and a photo sticker creating game for another user in parallel.

  The ceiling strobe unit 14 provided above the photographing space incorporates a strobe that emits a flash toward the photographing space in accordance with the photographing timing. A fluorescent lamp is arranged inside the ceiling strobe unit 14 and also functions as illumination of the photographing space.

  On the upper part of the rear unit 12B, a background curtain unit 15 in which a movable curtain (background curtain) used for the background is stored is provided. The background curtain unit 15 stores a plurality of winding curtains having different colors or patterns. The background curtain unit 15 operates in conjunction with a photographing function such as a camera or a strobe provided in the front unit 12A. At the time of photographing, for example, the curtain of the color selected by the user is lowered and the other curtains are wound. take.

  The external monitor 16 provided on the side surface of the front unit 12A is used for a user who is waiting outside the shooting space to use the shooting space next time when shooting is performed in the shooting space, or a photo sticker. For those who pass by the creation device 1, a video showing the progress of the game is displayed, a video (demonstration) that guides the flow of the game, how to play, etc. is displayed, and the photo sticker creation device 1 is installed Display advertisements for the stores and areas that are used. The external monitor 16 is a tablet built-in monitor, displays a screen related to pre-service processing, and accepts a selection operation by the user.

  The speaker 17 outputs sound that matches the display on the external monitor 16.

  The touch pens 18a and 18b are used by a user who performs pre-service work. The user can select various items by tapping the external monitor 16 with the touch pen 18 (touch pens 18a, 18b) or moving the external monitor 16 on the external monitor 16. By preparing two touch pens, it becomes possible for two users to simultaneously perform a selection operation in the pre-service operation.

  FIG. 2 is a perspective view of the photo sticker creating apparatus 1 as seen from another angle.

  The editing unit 13 is installed adjacent to the surface of the front unit 12A opposite to the surface on the rear unit 12B side (surface on the imaging space side). On the two side surfaces of the editing unit 13, a first editing interface 13A and a second editing interface 13B are provided for the user to edit the captured image.

  Here, the flow of the photo sticker creation game and the accompanying movement of the user will be described with reference to FIG. FIG. 3 is a plan view of the photo sticker creating apparatus 1 as viewed from above.

  A user (user A) who has paid for the coin insertion slot 55 in the pre-service space 31 in front of the external monitor 16 uses the touch pen 18 according to the screen displayed on the external monitor 16. Set up. In the prior customer service space 31, for example, selection as to whether or not to use a mobile transmission function that is a function of transmitting an image to a server is performed as a prior customer service.

  The user who has completed the customer service operation enters the imaging space 32 formed between the front unit 12A and the rear unit 12B, and performs the imaging operation using a camera or a monitor provided in the front unit 12A (user B).

  The user who has finished the shooting work selects an image to be edited from the shot images, and after selecting the image, for example, according to the movement guide displayed on the monitor of the front unit 12A, from the shooting space 32 to the editing space in which the editing work is performed. Moving.

  A first editing space 33A is formed on the right side (in front of the first editing interface 13A) of the editing unit 13 as viewed from the front unit 12A, and a second editing space 33B is formed on the left side (in front of the second editing interface 13B). The Hereinafter, when it is not necessary to distinguish the first editing space 33A and the second editing space 33B as appropriate, they are collectively referred to as an editing space 33.

  The user (user B) of the shooting space 32 is guided to the free one of the two editing spaces when the shooting operation is finished. The user who has moved to the first editing space 33A or the second editing space 33B starts editing work. A user C who is a user of the first editing space 33A and a user C ′ who is a user of the second editing space 33B can simultaneously perform editing work.

  The user who has finished the editing work next performs a print setting work such as setting the number of divisions in the editing space 33. After the print setting work is completed, printing is started. During image printing, if the user has selected to use the mobile transmission function during customer service, the user can select an image to be stored on the server from among the edited images or play a mini game. Or When printing is completed, the user moves to the printed material receiving area 34 to receive the sticker paper, and finishes a series of photo sticker creation games.

  Next, the configuration of each unit will be described.

  FIG. 4 is a diagram illustrating a configuration example of the front unit 12A. A front surface 12 </ b> A- 1 in FIG. 4 is a surface that is positioned forward for a user who performs a photographing operation in the photographing space 32.

  A camera 51 that captures a subject in the imaging space 32 is provided in the approximate center of the front surface 12 </ b> A- 1, and a touch panel monitor 52 is provided below the camera 51.

  The front surface 12A-1 is provided with lighting devices 53-1 to 53-8 that emit light in accordance with the shooting timing of the camera 51, and a baggage storage area for a user who is shooting to put baggage or the like. 54-1 and 54-2 are provided on the left and right with the illumination device 53-7 under the touch panel monitor 52 interposed therebetween. For example, near the ceiling of the front surface 12 </ b> A- 1, a speaker that outputs sound such as guidance sound, BGM (Back Ground Music), and sound effects in the shooting work of the photo sticker creation game is also provided.

  The camera 51 is configured by an image sensor such as a CCD (Charge Coupled Device), and photographs the user in the photographing space 32. A part of the captured image captured by the camera 51 is cut out or an image such as a background is synthesized and displayed on the touch panel monitor 52 in real time. An image captured by the camera 51 at a predetermined timing such as when a user gives an instruction to shoot is saved as a photographic image (still image).

  The touch panel monitor 52 includes a live view monitor such as an LCD (Liquid Crystal Display) and a touch panel laminated thereon. The touch panel monitor 52 has a function as a live view monitor that displays a composite image (moving image) obtained by combining an image such as a background or foreground with a captured image captured by the camera 51, and various GUI (Graphical User Interface) images. And a function of accepting a user's selection operation by a touch panel superimposed on the screen.

  FIG. 5 is a diagram showing a configuration example of the editing unit 13 on the right side when viewed from the photographing unit 12 side (configuration example on the first editing space 33A side).

  The first editing interface 13A is provided with a tablet built-in monitor 62, touch pens 63-1, 63-2, and a speaker 64. A lighting device 61 is also provided above them.

  The tablet built-in monitor 62 is configured by superimposing a tablet capable of operation input using the touch pen 63-1 or 63-2 on a display device such as an LCD. On the tablet built-in monitor 62, for example, an edit screen that is a screen used for editing the image to be edited is displayed. When two people perform editing work simultaneously, the touch pen 63-1 is used by one user, and the touch pen 63-2 is used by the other user. Hereinafter, the touch pen 63-1 and the touch pen 63-2 are collectively referred to as a touch pen 63, as appropriate.

  The speaker 64 outputs voices related to editing work such as guidance voices, sound effects, and BGM. The configuration of the editing unit 13 on the second editing space 33B side is basically the same as the configuration on the first editing space 33A side shown in FIG.

  FIG. 6 is a diagram illustrating a configuration example of the photo sticker discharge unit 13 </ b> C of the editing unit 13.

  A photographic sticker discharge port 71 is provided in the photographic sticker discharge portion 13C. The photo sticker discharge port 71 is obtained by a sticker on which an image obtained by editing by the user of the first editing space 33A is printed and by a user of the second editing space 33B. The sticker paper on which the printed image is printed is discharged. A printer is provided inside the editing unit 13, and an image obtained by editing work is printed by the printer.

  Next, the internal configuration of the photo sticker creating apparatus 1 will be described. FIG. 7 is a block diagram illustrating an internal configuration example of the photo sticker creating apparatus 1. The same code | symbol is attached | subjected to the same structure as the structure mentioned above. The overlapping description will be omitted as appropriate.

  The control unit 101 controls the overall operation of the photo sticker creating apparatus 1. Connected to the control unit 101 are a storage unit 102, a communication unit 103, a drive 104, a ROM (Read Only Memory) 106, a RAM (Random Access Memory) 107, a pre-service unit 111, a photographing unit 112, an editing unit 113, and a printer 114. Is done.

  The storage unit 102 includes a non-volatile storage medium such as a hard disk or a flash memory, and stores various setting information supplied from the control unit 101. Information stored in the storage unit 102 is appropriately read out by the control unit 101.

  A communication unit 103 is an interface of a network such as the Internet, and communicates with an external device according to control by the control unit 101.

  A removable medium 105 made of an optical disk (including a CD-ROM (Compact Disc-Read Only Memory) and a DVD (Digital Versatile Disc)), a semiconductor memory, and the like is appropriately attached to the drive 104. The computer program and data read from the removable medium 105 by the drive 104 are supplied to the control unit 101 and stored in the storage unit 102 or installed.

  The ROM 106 stores programs and data executed by the control unit 101. The RAM 107 temporarily stores data and programs processed by the control unit 101.

  The pre-service section 111 is a block that performs pre-service processing, which is processing for causing the user to perform pre-service work, and includes an external monitor 16, a speaker 17, a touch pen 18, and a coin processing section 121.

  The external monitor 16 displays an image that guides the flow of the photo sticker creation game, how to play, and the like according to control by the control unit 101. In addition, the external monitor 16 displays a selection screen for determining whether or not to use the mobile transmission function after the price is inserted. A signal representing the content of the user's operation input to the external monitor 16 is supplied to the control unit 101.

  The coin processing unit 121 detects the insertion of coins into the coin insertion slot 55. When the coin processing unit 121 detects that a coin has been inserted, the coin processing unit 121 outputs an activation signal indicating that to the control unit 101.

  The photographing unit 112 is a block that performs photographing processing, which is processing for causing a user to perform photographing work, and includes a background curtain unit 15, an illumination control unit 122, a camera 51, a touch panel monitor 52, and a speaker 124. .

  The background curtain unit 15 raises and lowers the background curtain based on the background control signal supplied from the control unit 101. The background may be selected manually by the user. As for the background curtain, one of a plurality of elevating curtains is used as a chroma curtain, or the chroma curtain is pasted on the back of the shooting space in advance and is used for editing used in the editing process. By preparing a plurality of background images, the user may be able to synthesize a desired background image for synthesis on the blackboard curtain portion during editing.

  The illumination control unit 122 turns on or off the illumination devices 53-1 to 53-8 based on the illumination control signal supplied from the control unit 101.

  The camera 51 shoots according to the control by the control unit 101 and outputs image data obtained by the shooting to the control unit 101. In the photographing process, photographing is performed a plurality of times, and a predetermined number of images selected from the plurality of photographed images are stored in the storage unit 102 as editing target images.

  The editing unit 113 is a block that performs an editing process that is a process for causing the user to perform an editing operation. The editing unit 113 includes a first editing unit 113A corresponding to the first editing interface 13A and a second editing interface corresponding to the second editing interface 13B. 2 editing section 113B. Although the configuration of the first editing unit 113A will be described here, the second editing unit 113B also has the same configuration as the first editing unit 113A.

  The first editing unit 113A includes a tablet built-in monitor 62, touch pens 63-1, 63-2, and a speaker 64.

  The tablet built-in monitor 62 includes an editing monitor 141 and a tablet 142, displays an editing screen according to control by the control unit 101, and detects a user operation on the editing screen. A signal representing the content of the user's operation is supplied to the control unit 101, and the editing target image is edited. On the editing screen, thumbnail images of the image to be edited stored in the storage unit 102 are displayed, and one image to be edited selected by tapping the thumbnail image is displayed in a larger size than the thumbnail image. The user switches the image to be edited to be displayed as appropriate, and inputs handwritten characters using the pen tool displayed on the editing screen or the stamp tool for the enlarged image to be edited. You can enter an image such as a heart pattern.

  The printer 114 prints the edited image obtained by the editing process on the sticker sheet 162 and discharges it to the photo sticker discharge port 71.

  FIG. 8 is a block diagram illustrating a functional configuration example of the control unit 101. The configuration shown in FIG. 8 is realized by the control unit 101 executing a predetermined program. In the control unit 101, a pre-service processing unit 201, a photographing processing unit 202, an editing processing unit 203, a print processing unit 204, and a post-service service processing unit 205 are realized.

  The pre-service processing unit 201 performs pre-service processing, which is processing related to a price (coin) input when starting the photo sticker creation game, processing related to setting before photographing, and the like. The photographing processing unit 202 performs photographing processing that is processing for photographing the user. The editing processing unit 203 performs editing processing such as editing on the captured image. The print processing unit 204 performs a printing process for printing an image obtained by the editing process on a sticker sheet. The post-service processing unit 205 performs post-service processing that provides a mini game or the like to a user who has finished editing work and is waiting for printing.

  That is, the control unit 101 controls processing relating to each process of the photo sticker creation game.

  FIG. 9 is a functional block diagram illustrating a detailed configuration example of the imaging processing unit 202.

  In FIG. 9, the imaging processing unit 202 includes an imaging control unit 211, a display control unit 212, and a boundary area editing processing unit 213.

  The imaging control unit 211 receives a synthesis image selection instruction for the user to select a synthesis image to be synthesized with the captured image, controls the camera 51 in accordance with the synthesis image selection instruction, and starts shooting. In addition, the shooting control unit 211 combines the combining image selected based on the combining image selection instruction by the user with the moving image or the captured image acquired by the camera 51. Then, the shooting control unit 211 temporarily stores the shot image obtained as a result of the synthesis in the RAM 107 or the like, for example. Of the captured images obtained by compositing the compositing images stored in the RAM 107 in this manner, the image selected as the image to be edited by the user is stored in the storage unit 102 and used as an edited image in editing work. Note that the composition image to be synthesized with the photographed image is stored in advance in the storage unit 102, for example. Further, the composition image is an image synthesized as a foreground or background on the photographed image at the time of photographing processing, and includes a decoration image (for example, an aura image or the like) synthesized on the outer edge of the person image. Specifically, the composition image is, for example, a background image or foreground image in which a picture including at least one of a picture, a pattern, a figure, and a character is added to an image of a person who is a subject. There are a “frame image” and a “simple image” which is a background image consisting only of colors and patterns.

  The display control unit 212 controls the display of a GUI for the user to select a composition image to be combined with the captured image, or displays on the touch panel monitor 52 a moving image or a captured image in which the combination image is combined. To control.

  The boundary area editing processing unit 213 performs predetermined image editing processing on a boundary area that is an area including the boundary between the subject area and the background area in the captured image obtained by combining the images for synthesis.

  FIG. 10 is a functional block diagram illustrating a detailed configuration example of the boundary area editing processing unit 213 in FIG.

  The boundary area editing processing unit 213 includes a composite image blurring processing unit 231, a color adjustment unit 232, a mask image generation unit 233, a binarization processing unit 234, a mask image blurring processing unit 235, a boundary region setting unit 236, an extraction unit 237, And a combining unit 238.

  The composite image blurring processing unit 231 performs a filter process with a blurring effect on the composite image obtained by combining the composite image with the photographed image acquired by the camera 51 based on the control of the photographing control unit 211, and as a result. The obtained blurred composite image is supplied to the color adjustment unit 232.

  The color adjustment unit 232 adjusts the color of the blurred composite image from the composite image blur processing unit 231 and supplies the adjusted color to the extraction unit 237. Specifically, the color adjustment unit 232 adjusts one or both of the brightness and the saturation of the blurred composite image.

  The mask image generation unit 233 determines, from the captured image acquired by the camera 51 based on the control of the imaging control unit 211, a subject region that is a subject region in the captured image and a background region that is a background region other than the subject region. A mask image is generated and is supplied to the binarization processing unit 234.

  The binarization processing unit 234 performs binarization processing on the mask image generated by the mask image generation unit 233, using pixels in the subject area as white pixels and pixels in the background area as black pixels.

  The mask image blurring processing unit 235 performs a filtering process having a blurring effect on the mask image binarized by the binarization processing unit 234, and the resultant blur mask image is converted into a boundary region setting unit. 236.

  The boundary area setting unit 236 sets an area including the boundary between the subject area (white area) and the background area (black area) (area near the boundary) as the boundary area in the blurred mask image from the mask image blurring processing unit 235. Then, boundary region information representing the boundary region is supplied to the extraction unit 237.

  The extraction unit 237 extracts a portion corresponding to the boundary region represented by the boundary region information from the boundary region setting unit 236 from the color-adjusted blurred combined image from the color adjustment unit 232, and combines the extracted image with the combination To the unit 238.

  The combining unit 238 combines the extracted image from the extracting unit 237 and a combined image obtained by combining the captured image with the combined image. The composite image obtained by combining the extracted images is displayed on the touch panel monitor 52 under the control of the display control unit 212.

  Next, the flow of the photo sticker creating game performed in the photo sticker creating apparatus 1 will be described with reference to the flowchart of FIG.

  In step S1, the coin processing unit 121 of the photo sticker creating apparatus 1 determines whether or not a coin has been inserted, and waits until it is determined that the coin has been inserted.

  If it is determined in step S1 that a coin has been inserted, in step 2, the pre-service processing unit 201 performs pre-service processing. For example, whether or not to use the function of mobile transmission is selected by the pre-service processing, and when the use is selected, the input screen for the mail address of the mobile terminal device such as the user's mobile phone is displayed on the external monitor 16. Is displayed. The user inputs the mail address of his / her mobile terminal device.

  In step S3, the imaging processing unit 202 performs imaging processing. The photographed image obtained by the photographing process is displayed on the touch panel monitor 52, and the editing target image selected from the photographed image is supplied to the editing processing unit 203. The details of the shooting process will be described later with reference to FIG. 12, but six shot images, for example, are obtained by the shooting process.

  In step S4, the edit processing unit 203 displays an edit screen and performs an edit process in accordance with a user operation. As described above, the editing process inputs an image (editing composition image) such as a handwritten character or pattern or a heart pattern prepared in advance for the image to be edited.

  In step S5, the post-service processing unit 205 performs post-service processing. When the use of the mobile transmission function is selected during the pre-service processing, the post-service processing unit 205 displays the image to be edited on the tablet-incorporated monitor 62, and a predetermined number of images are transmitted from the mobile phone. Let the user select it as a trusted image.

  The image selected as the portable transmission image is transmitted from the photo sticker creating apparatus 1 to the server together with the mail address input by the user, and is stored in a storage medium included in the server. An e-mail including a URL indicating the storage destination is transmitted from the server to the user's mobile terminal device. When the user operates the mobile terminal device to instruct access to the URL included in the e-mail, the server is accessed and the mobile transmission image is displayed on the display of the mobile terminal device.

  In step S <b> 6, the print processing unit 204 controls the printer 114 to perform a printing process for printing the edited image obtained by the editing process on the sticker sheet 162.

  In step S <b> 7, the print processing unit 204 guides the movement forward of the photo sticker discharge port 71 by displaying a predetermined screen on the tablet built-in monitor 62.

  When printing is completed, in step S8, the print processing unit 204 discharges the sticker sheet 162 on which the edited image is printed to the photo sticker discharge port 71, and ends the process.

  The photo sticker creation game is performed according to the above flow.

  Next, the detailed flow of the photographing process executed in step S2 of FIG. 12 will be described with reference to the flowchart of FIG. In the photographing process, as described above, finally, for example, six photographed images are determined as editing processing targets.

  In step S <b> 51, the display control unit 212 of the photographing processing unit 202 displays a composition image to be combined with the photographed image on the touch panel monitor 52 and allows the selection. Here, six types of composition images are selected by the user so as to correspond to each of the six photographed images. Note that the user can select two or more images for the same composition.

  When the user selects six images for composition on the touch panel monitor 52, the process proceeds to step S52, and the display control unit 212 displays the moving image obtained by photographing the subject by the camera 51 in real time in step S51. An image obtained by combining one of the selected combining images is displayed on the touch panel monitor 52 as a live view image.

  In step S53, the display control unit 212 displays a countdown indicator on the touch panel monitor 52, and the imaging control unit 211 performs imaging (acquisition of a still image) when the count value of the countdown indicator becomes zero.

  In step S54, the boundary area editing processing unit 213 performs boundary area editing processing on the synthesized image obtained by synthesizing the captured image (still image) with the synthesis image synthesized with the live view image. Details of the boundary area editing process will be described later with reference to FIG.

  In step S55, the display control unit 212 causes the touch panel monitor 52 to display the captured image (composite image) that has been subjected to the boundary region editing process in the process of step S54, and allows the user to confirm.

  In step S56, the imaging control unit 211 determines whether N times of imaging have been performed. Here, N is a numerical value corresponding to the number of shots to be shot. In this case, the value of N is 6.

  In step S56, if the value of variable X is less than N, it is determined that N shootings have not been performed yet, the process proceeds to step S57, and the value of variable X is incremented by 1. The process returns to step S52.

  In step S53, the second shooting is performed, and the process proceeds to steps S54 to S56.

  As described above, the processes in steps S52 to S56 are repeatedly executed until it is determined in step S56 that N times of photographing have been performed. If it is determined in step S56 that N times of shooting have been performed, the process proceeds to step S58.

  In step S58, the shooting control unit 211 determines whether the time is within the shooting possible time, in other words, whether there is a time to perform one or more more shootings with respect to the preset shooting time. If it is determined in step S58 that the time is not within the shootable time, the process proceeds to step S60.

  On the other hand, if it is determined in step S58 that the time is within the shootable time, the process proceeds to step S59, and the shooting control unit 211 causes the user to perform a bonus shot as additional shooting. Specifically, for example, the imaging control unit 211 performs the processes of steps S52 to S55 described above using any one of the selected background images. It should be noted that bonus shots can be performed a plurality of times according to the remainder of the shooting time. After the bonus shot ends, the process proceeds to step S60.

  In step S60, the imaging control unit 211 stores the N captured images captured in the process of step S53 in the storage unit 102 as editing target images, and the imaging process ends. When a bonus shot is performed, the display control unit 212 causes the touch panel monitor 52 to display N shot images and a shot image based on the bonus shot, thereby allowing the user to display the N shot images and the bonus shot. The image to be edited is selected from the captured images obtained by, and the imaging control unit 211 causes the storage unit 102 to store the selected captured image.

  Next, an example of a detailed flow of the boundary area editing process executed in step S54 of FIG. 12 will be described with reference to the flowchart of FIG.

  In step S71, the synthesized image blurring processing unit 231 uses, for example, a low-pass filter to synthesize a synthesized image such as a background image with the captured image acquired in step S53 of FIG. Apply blur processing to blur the image. The composite image blurring processing unit 231 supplies the blur combined image obtained as a result of the blurring process to the color adjusting unit 232.

  Specifically, as illustrated in the upper left side of FIG. 14, when a composite image A in which a background image is combined with a captured image is acquired, the composite image blurring processing unit 231 indicates the upper center of FIG. 14. Such a blurred composite image B is obtained. Of course, the blurring processing method is not limited to the method using the low-pass filter, and other methods may be used.

  In step S <b> 72, the color adjustment unit 232 adjusts the color of the blurred composite image B from the composite image blur processing unit 231. For example, when the color adjustment unit 232 adjusts the brightness of the blurred composite image B to be high, a bright blurred composite image C as illustrated on the upper right side of FIG. 14 is obtained. The blur combined image C with the color (lightness) adjusted as described above is supplied to the extraction unit 237.

  In step S73, the mask image generation unit 233 performs a chroma process, a skin area detection process, and the like on the captured image acquired in step S53 of FIG. A mask image to be divided is generated and supplied to the binarization processing unit 234.

  Specifically, based on the control of the shooting control unit 211, the camera 51 is a shot image D as shown on the upper left side of FIG. 15, that is, an image in which a synthesis image such as a background image is not synthesized. When the captured image D whose background color is the color of the black curtain is acquired, the mask image generation unit 233 generates a mask image E as shown in the upper center of FIG. The mask image E in FIG. 15 is a mask image in which a region other than the subject region, that is, the background region is masked, but may be a mask image in which the subject region is masked.

  In step S 74, the binarization processing unit 234 performs binarization processing on the mask image from the mask image generation unit 233 and supplies the mask image to the mask image blurring processing unit 235 and the boundary region setting unit 236.

  Specifically, the binarization processing unit 234 sets the pixel value of the pixel in the subject area to (R, G, B) = (255,255,255) for the mask image E in FIG. 15 (that is, the pixel in the subject area). (R, G, B) = (0,0,0) (that is, the background area pixel is a black pixel). Thereby, the binarized mask image F shown on the upper right side of FIG. 15 is obtained.

  In step S75, the mask image blurring processing unit 235 performs blurring processing for blurring the binarized mask image F from the binarization processing unit 234 using, for example, a low-pass filter. As a result, the blur mask image G shown on the lower left side of FIG. 15 is obtained and supplied to the boundary region setting unit 236. In the blur mask image G of FIG. 15, for example, the boundary between the subject area and the background area is smoothed, and the vicinity of the boundary is a gray area.

  In step S76, the boundary region setting unit 236 determines the boundary between the subject region and the background region in the captured image based on the binarized mask image F before the blurring process and the blur mask image G after the blurring process. Set the boundary area to include.

  Specifically, for example, the boundary region setting unit 236 assigns a pixel value of 1 to a white pixel in the mask image F and assigns a pixel value of 0 to a black pixel. Similarly, the boundary region setting unit 236 assigns a pixel value of 1 to white pixels in the blur mask image G and assigns a pixel value of 0 to black pixels.

  Then, the boundary area setting unit 236 uses an exclusive OR for each corresponding pixel of the mask image F and the blurred mask image G to which pixel values are newly assigned, and determines an area composed of true pixels. Set as the border area. That is, in the mask image F and the blur mask image G, if the pixel value of the corresponding pixel is 0 or 1, the pixel is false, and if the pixel value of the corresponding pixel is different, the pixel is true. Become.

  Here, for example, in a region that is a gray region in the blur mask image G, white pixels and black pixels are mixed, and therefore the proportion of pixel values of the corresponding pixels in the region increases. . Specifically, in the gray region, white pixels gradually decrease from the subject region to the background region, and black pixels gradually increase from the subject region to the background region. Therefore, when exclusive OR is used for only white pixels, the number of true pixels (white pixels) increases from the subject area to the boundary, and decreases from the boundary to the background area. Similarly, when exclusive OR is used for only black pixels, the number of true pixels (black pixels) increases from the subject area to the boundary, and decreases from the boundary to the background area. As a result, the boundary area composed of pixels that are true using exclusive OR is compared to the boundary between the subject area and the background area, which is represented by a white area in the image H shown on the lower right side of FIG. In the boundary region of the image H, the pixel density increases from both ends (subject region side and background region side) to a portion corresponding to the boundary between the subject region and the background region. . In other words, in the boundary region of the image H, the density of the pixels is different centering on the portion corresponding to the boundary between the subject region and the background region.

  The boundary area setting unit 236 supplies boundary area information representing the boundary area set in this way to the extraction unit 237.

  In step S 77, the extraction unit 237 extracts a portion corresponding to the boundary region represented by the boundary region information from the boundary region setting unit 236 from the color-adjusted blurred combined image from the color adjustment unit 232.

  Specifically, the extraction unit 237 extracts a portion (pixel) corresponding to the boundary region shown in the image H of FIG. 15 from the bright blurred composite image C of FIG. The extracted image I is acquired and supplied to the synthesizing unit 238. The extracted image I shown in FIG. 14 is a border region image 300 obtained by cutting out a region near the boundary between the subject region and the background region in the composite image A (captured image F) before the blur processing is performed in the bright blur composite image C. An image consisting of Further, the pixels of the bright blurred composite image C extracted corresponding to the boundary region of the image H have a higher density from both ends to the portion corresponding to the boundary. Therefore, the boundary region image 300 is the bright blurred composite image C. The image in the vicinity of the boundary in FIG. 2 is an image that is brightly emphasized around the boundary and appears to be less blurred as it is closer to both ends.

  In step S <b> 78, the combining unit 238 combines the combined image obtained by combining the captured image with the combining image and the extracted image from the extracting unit 237. That is, by combining the composite image A and the extracted image I in FIG. 14, a boundary region edit image J shown on the lower right side of FIG. 14 is generated. The boundary area edited image J in FIG. 14 is an image in which the boundary area image 300 as the extracted image I is superimposed on the boundary portion between the subject area and the background area in the composite image A. The boundary area edited image J is displayed on the touch panel monitor 53 as a captured image (composite image) under the control of the display control unit 212.

  Here, with reference to FIG. 16, the boundary region between the subject region and the background region in the boundary region edited image J of FIG. 14 will be described.

  In FIG. 16, a boundary region as a part of the boundary region image 300 is shown. In the center of the boundary region, a boundary line 301 representing the boundary between the subject region and the background region, and on the left side of the boundary line 301, A boundary line 302 that represents the boundary between the boundary area image 300 and the subject area, and a boundary line 303 that represents the boundary between the boundary area image 300 and the background area are shown on the right side of the boundary line 301.

  According to the above processing, the combined image is subjected to the blurring process and corresponds to the boundary area including the boundary between the subject and the background from the bright blurred image obtained by performing the color adjustment to increase the brightness. A partial boundary region image is extracted, and the extracted boundary region image and the composite image are combined. Thereby, in the boundary area of the boundary area edited image J, as shown on the left side of FIG. 16, the subject area on the left side of the boundary line 302 (subject side) and the background area on the right side of the boundary line 303 (background side) ), The brightness is higher. In particular, in the boundary area image, the image is brightly emphasized around the boundary line, and the closer to both ends (the subject side and the background side), the lower the blurring degree, the lower the blur condition. The vicinity of the boundary with the background has a bright color, and it is possible to obtain a composite image (edit target image) with a three-dimensional finish that looks like light is shining from behind the subject. As a result, a realistic sense of depth can be provided between the subject and the background, and as a result, the user's satisfaction with the created photo sticker can be improved.

  In the above description, the color adjustment is performed so as to increase the brightness of the synthesized image subjected to the blurring process. However, the color adjustment may be performed so as to decrease the brightness. Thereby, in the boundary area of the boundary area edited image J, as shown on the right side of FIG. 16, the subject area on the left side of the boundary line 302 (subject side) and the background area on the right side of the boundary line 303 (background side) ), The brightness is lower. In particular, in the boundary area image, the darkness is emphasized centering on the boundary line, and the nearer the both ends (the subject side and the background side), the lower the blurring degree, so the subject in the composite image can be seen with a very natural feeling. It is possible to obtain a composite image (editing target image) with a three-dimensional finish in which the subject is conspicuous in which the vicinity of the boundary with the background has a dark hue and there is a shadow in the contour portion of the subject. As a result, a realistic sense of depth can be provided between the subject and the background, and as a result, the user's satisfaction with the created photo sticker can be improved.

  Further, the color adjustment unit 232 may perform the color adjustment for changing the brightness as described above according to the color of the synthesis image (for example, the background image) to be synthesized with the photographed image.

  For example, when the color of the background image is a color with high brightness, the color adjustment unit 232 performs color adjustment to lower the brightness of the composite image that has been subjected to the blurring process, and the color of the background image has the brightness. In the case of a low color, color adjustment may be performed so as to increase the brightness of the combined image subjected to the blurring process. As a result, in a composite image having a three-dimensional finish, a clearer sense of depth can be produced between the subject and the background.

  Further, as shown in FIG. 16, the brightness of the boundary area is adjusted uniformly. However, as shown in FIG. 17, in the boundary area, the inner side of the boundary line 301 (the boundary line 301 and the boundary line). The brightness may be different between the area between the boundary line 301 and the outside of the boundary line 301 (the area between the boundary line 301 and the boundary line 303). In this case, the color adjustment unit 232 performs color adjustment again on the boundary image 300 (FIG. 14) of the extracted image I or the boundary region edit image J.

  In the example of FIG. 17, the brightness on the inside of the boundary line 301 in the boundary area, that is, the brightness on the subject side in the boundary area is adjusted high, and the brightness on the outside of the boundary line 301 in the boundary area, that is, the background side in the boundary area is adjusted low. Yes. As a result, it is possible to obtain a composite image with a three-dimensional finish that allows the subject to appear.

  In FIG. 17, the brightness on the inside of the boundary line 301 in the boundary region is adjusted to be high and the brightness on the outside of the boundary line 301 in the boundary region is adjusted to be low. The lightness inside 301 may be adjusted low, and the lightness outside the boundary line 301 in the boundary region may be adjusted high. Further, the brightness in the boundary region may not be uniform for each region (portion) as shown in FIGS. 16 and 17, for example, may gradually decrease from the boundary line 302 to the boundary line 303. In the example 17, it gradually increases from the boundary line 302 to the boundary line 301, gradually increases from the boundary line 301 to the boundary line 303, and gradually increases from the boundary line 302 to the boundary line 301. It may be gradually lowered over time.

  Furthermore, in the above, the color adjustment unit 232 performs the color adjustment to change the brightness as described above. However, the color adjustment unit 232 may change the saturation instead of the brightness, or may change both the brightness and the saturation. It may be changed. As a result, it is possible to obtain a three-dimensional composite image in which the subject smoothly harmonizes with the background and a three-dimensional composite image in which the subject is conspicuous.

  In the above description, the boundary region setting unit 236 sets the boundary region for each corresponding pixel of the mask image and the blur mask image using exclusive OR, but adjusts the width of the boundary region. can do.

  Specifically, for example, in the blurring process by the mask image blurring processing unit 235, by increasing the blurring degree representing the degree of blurring, the width of the boundary region set by the boundary region setting unit 236 can be increased.

  Further, in the gray area in the vicinity of the boundary between the subject area and the background area in the blur mask image G of FIG. 15, the gray density actually ranges from the white area (subject area) to the black area (background area). Gradually becomes darker.

  Therefore, for example, the boundary region setting unit 236 sets a value of 0.1 to 0.9 corresponding to the gray density for the pixels in the gray region in the blur mask image G, and the value is equal to or less than a threshold value such as 0.3, for example. If the pixel value is 0, the pixel value of the pixel is regarded as 0, and if the value is equal to or greater than a threshold value such as 0.7, the pixel value of the pixel is regarded as 1 and a boundary region is set using exclusive OR. You may make it do.

  When the boundary region is set in this way, the width Wa between the boundary line 301 and the boundary line 302 and the width between the boundary line 301 and the boundary line 303 shown in FIG. Wb can be adjusted.

  Thus, in the boundary area, if the width Wa between the boundary line 301 and the boundary line 302 and the width Wb between the boundary line 301 and the boundary line 303 can be adjusted, An interesting sense of depth can be produced between the subject and the background. Further, after adjusting the widths Wa and Wb, as shown in the example of FIG. 17, by adjusting the brightness (or saturation) to be different between the inside and the outside of the boundary line 301 in the boundary region, In the finished composite image, it is possible to expect a more interesting depth feeling between the subject and the background.

  Furthermore, in the above, the boundary area editing process is uniformly applied to all the boundaries between the subject area and the background area. However, the blurring degree is applied to the boundary between the subject skin area and the background area. It is also possible to perform a lower boundary area editing process.

  FIG. 19 is a functional block diagram illustrating a detailed configuration example of the boundary region editing processing unit 213 that performs boundary region editing processing with a low degree of blurring on the boundary between the subject skin region and the background region. In addition, in the boundary area edit processing unit 213 in FIG. 19, components having the same functions as those provided in the boundary area edit processing unit 213 in FIG. Shall be omitted as appropriate.

  That is, the boundary region editing processing unit 213 in FIG. 19 differs from the boundary region editing processing unit 213 in FIG. 10 in that the skin region detection unit 401 and the synthetic image blurring processing unit 402 are replaced with the composite image blurring processing unit 231. It is a point provided.

  The skin region detection unit 401 exposes skin such as a user's face and hands in a composite image obtained by combining a composite image with a captured image acquired by the camera 51 based on the control of the photographing control unit 211. A region (hereinafter referred to as a skin region) is detected, and skin region information representing the skin region is supplied to the composite image blurring processing unit 402.

  Based on the skin region information from the skin region detection unit 401, the composite image blur processing unit 402 performs a filter process having a blur effect on the composite image, and the resultant blur composite image is converted into a color adjustment unit. 232 is supplied.

  The boundary region editing process by the boundary region editing processing unit 213 in FIG. 19 is basically the same as the boundary region editing process by the boundary region editing processing unit 213 in FIG. 10 described with reference to the flowchart in FIG. It is. However, in the boundary region editing process by the boundary region editing processing unit 213 in FIG. 19, the composite image blurring process described with reference to FIG. 20 is executed in step S <b> 71 of the flowchart in FIG. 13.

  Here, the composite image blurring process in the boundary area editing process by the boundary area editing processing unit 213 in FIG. 19 will be described with reference to the flowchart in FIG.

  In step S111, in a composite image (for example, composite image A in FIG. 14) in which the composite image is combined with the captured image acquired in step S53 in FIG. 12, the skin of the user's face and hands is exposed. The detected skin area is detected, and skin area information representing the skin area is supplied to the composite image blurring processing unit 402.

  In step S <b> 112, based on the skin area information from the skin area detection unit 401, the composite image blurring process unit 402 determines whether the area of the composite image that is the target of the blurring process is a skin area.

  If it is determined in step S112 that the region of the composite image to be subjected to blurring processing is not a skin region, the process proceeds to step S113, and the composite image blurring processing unit 402 sets the region of the composite image to be subject to blurring processing. On the other hand, the blurring process similar to the blurring process described above is performed.

  On the other hand, if it is determined in step S112 that the region of the composite image to be subjected to the blurring process is a skin region, the process proceeds to step S114, and the composite image blurring processing unit 402 performs the composite image to be subjected to the blurring process. A blurring process with a lower blurring degree that represents the degree of blurring than the blurring process described above is applied to the area. Here, the composite image blurring processing unit 402 may perform blurring processing with the blurring degree set to zero. That is, in this case, the blurring process is not performed on the skin area.

  According to the above process, the blurring process with a low blurring degree is performed on the skin area in the composite image. As a result, in the extracted image I (FIG. 14), that is, in the boundary region image 300, the contour of the user's face and hand is close to the natural state. The boundary with the background is a natural and finished image.

  Note that the composition image for editing selected by the user in the editing process may be determined according to the content of the boundary region editing process for the composite image (edit target image) obtained as described above. Good.

  Specifically, for example, when boundary region editing processing is performed on a composite image (image to be edited) so that the vicinity of the boundary between the subject and the background has a dark color, the editing processing unit 203 performs editing processing. Allows the user to select a light color or pre-blurred background image as a background image to change the background image of the image to be edited, and edit to input (synthesize) the image to be edited As an image for image composition, an image or character with a clear color or a clear outline is selected.

  As a result, the edited image obtained by the editing work is used for a cover of a fashion magazine, for example, which is composed of a light background, a subject that looks prominently with a shadow on the outline, and a sharp character. As a result, the user's satisfaction with the photo sticker can be improved.

  Note that the combination of the content of the boundary region editing process in the composite image, the background image, and the composite image for editing may be a combination other than the combinations described above.

  In addition, when a background image is selected as a composition image in the shooting operation and the color of the background image is changed in the editing operation, the image for editing is subjected to image processing according to the changed color of the background image. You may make it make a user select the image for a synthesis | combination. Specifically, when a pink background image is selected in the shooting operation and the color of the background image is changed to red in the editing operation, the editing composite image that has been subjected to image processing that matches red is selected. The user may be allowed to select.

  By the way, the above-described series of processes can be executed by hardware or can be executed by software. When the above-described series of processing is executed by software, a program constituting the software is installed from a network or a recording medium.

  For example, as shown in FIG. 7, the recording medium is distributed to distribute the program to the administrator of the photo sticker creating apparatus 1 separately from the apparatus main body, and is a magnetic disk (flexible disk) on which the program is recorded. Disk), optical disk (including CD-ROM and DVD), magneto-optical disk (including MD), or removable media 105 made of semiconductor memory, etc., but also pre-installed in the device body The ROM 106 in which the program is recorded and the hard disk included in the storage unit 102 are distributed to the administrator.

  In the present specification, the step of describing the program recorded on the recording medium is not limited to the processing performed in chronological order according to the described order, but is not necessarily performed in chronological order. It also includes processes that are executed individually.

  In the above, the printing medium is not limited to sticker paper or photographic paper. For example, printing on a predetermined size of paper or film, poster paper, a card such as a telephone card, or a cloth such as a T-shirt. You may make it do.

  Further, in this specification, the system represents the entire apparatus constituted by a plurality of apparatuses. In the above, the configuration described as one device may be divided and configured as a plurality of devices. Conversely, the configurations described above as a plurality of devices may be combined into a single device. Of course, configurations other than those described above may be added to the configuration of each device. Furthermore, if the configuration and operation of the entire system are substantially the same, a part of the configuration of a certain device may be included in the configuration of another device.

DESCRIPTION OF SYMBOLS 1 Photo sticker production apparatus 12 Image pick-up unit 101 Control part 112 Image pick-up part 202 Image pick-up process part 213 Boundary area edit process part 231 Composite image blurring process part 232 Color adjustment part 233 Mask image generation part 234 Binarization process part 235 Mask image blurring process Unit 236 boundary region setting unit 237 extraction unit 238 composition unit 401 skin region detection unit 402 composite image blur processing unit

Claims (8)

An image editing apparatus for photographing a user as a subject and outputting the obtained image,
Photographing means for photographing the user as a subject and obtaining a photographed image;
Detecting means for detecting a skin region that is a skin region of the subject in the photographed image;
A blurred image blur processing means for blurring the captured image and obtaining a blurred captured image;
Color adjusting means for obtaining a color adjusted photographed image by adjusting the color of the blurred photographed image;
In the captured image, a mask image generation means for generating a mask image obtained by masking an area other than the subject region,
A mask image blurring processing unit that performs blurring processing to blur the mask image and obtains a blurring mask image;
In the binarized mask image and the blur mask image, by using an exclusive OR with respect to the pixel value of the corresponding pixel, a subject region that is the subject region and a region other than the subject region A setting means for setting a boundary region having a width with respect to the boundary of the boundary, wherein the boundary region has different pixel densities around the boundary;
Extracting means for extracting a boundary area image of a portion corresponding to the boundary area from the color adjustment photographed image;
Combining means for combining the extracted boundary region image and the captured image;
The photographed image blurring processing unit performs a blurring process with a low degree of blurring on the skin region of the photographed image. The image editing apparatus according to claim 1, wherein the color adjustment unit adjusts one or both of brightness and saturation of the captured image to obtain the color-adjusted captured image. The image editing apparatus according to claim 1, wherein the color adjustment unit further adjusts a color of the boundary region image extracted by the extraction unit. The image editing apparatus according to claim 3, wherein the color adjustment unit adjusts the color so that the color is different between an inner side and an outer side of a boundary between the subject region and a region other than the subject region in the boundary region image. The image editing apparatus according to claim 1, wherein the setting unit variably adjusts the width of the boundary region. An editing unit that edits the synthesized image synthesized by the synthesizing unit based on an editing input by the user,
The image editing apparatus according to claim 1, wherein the editing unit causes the user to select the editing image according to color adjustment by the color adjusting unit as an editing image used for editing input. An image editing method of an image editing apparatus for photographing a user as a subject and outputting the obtained image,
A photographing step of photographing the user as a subject to obtain a photographed image;
A detection step of detecting a skin region that is a skin region of the subject in the captured image;
A blurred image blur processing step for blurring the captured image to obtain a blurred captured image;
A color adjustment step of obtaining a color adjusted photographed image by adjusting the color of the blurred photographed image;
In the captured image, a mask image generation step of generating a mask image obtained by masking an area other than the subject region,
A mask image blurring process step for blurring the mask image to obtain a blur mask image;
In the binarized mask image and the blur mask image, by using an exclusive OR with respect to the pixel value of the corresponding pixel, a subject region that is the subject region and a region other than the subject region A setting step for setting a boundary region having a width with respect to the boundary of the boundary, wherein the boundary region has different pixel densities around the boundary;
An extraction step of extracting a boundary region image of a part corresponding to the boundary region from the color adjustment photographed image;
Combining the extracted boundary region image and the captured image,
The photographed image blurring processing step is an image editing method in which a blurring process with a low degree of blurring is performed on the skin region of the photographed image. A program for causing a computer to execute a process of photographing a user as a subject and outputting the obtained image.
A photographing step of photographing the user as a subject to obtain a photographed image;
A detection step of detecting a skin region that is a skin region of the subject in the captured image;
A blurred image blur processing step for blurring the captured image to obtain a blurred captured image;
A color adjustment step of obtaining a color adjusted photographed image by adjusting the color of the blurred photographed image;
In the captured image, a mask image generation step of generating a mask image obtained by masking an area other than the subject region,
A mask image blurring process step for blurring the mask image to obtain a blur mask image;
In the binarized mask image and the blur mask image, by using an exclusive OR with respect to the pixel value of the corresponding pixel, a subject region that is the subject region and a region other than the subject region A setting step for setting a boundary region having a width with respect to the boundary of the boundary, wherein the boundary region has different pixel densities around the boundary;
An extraction step of extracting a boundary region image of a part corresponding to the boundary region from the color adjustment photographed image;
Causing the computer to execute a process including a combining step of combining the extracted boundary region image and the captured image;
The photographed image blurring processing step is a program for performing a blurring process with a low degree of blurring on the skin region of the photographed image.

Images