JP6709507B2 - Image processing apparatus and image forming apparatus - Google Patents

Description

The present invention relates to an image processing device and an image forming device.

A photograph taken by a camera or the like and developed on a paper medium such as photographic paper is displayed in various places using a photo frame. There are various types of ready-made photo frames, such as one that fits the face part of a photo into the face part of an animal or character, one that supports multiple photos, and one that has a heart or star shape. Off-the-shelf products have a fixed design, and the photo itself must be changed to another photo or cut according to the size of the frame mold.

On the other hand, an image creating apparatus prints an image for assembling a photo frame (see, for example, Patent Document 1). In the image for assembling a photo frame, the image creating device arranges a window shape having a specific shape (ellipse or the like) corresponding to a person portion in the photographic image.

JP, 2005-92661, A

However, in the above-described image creating apparatus, the window type created for the person in the photograph is limited to the window type having a specific shape (such as an ellipse), so that the design of the photo frame is adapted to the window type shape. This is not preferable because when the photo is displayed on the photo frame, a portion other than the person in the photo can be seen from the window shape of the specific shape.

The present invention has been made in view of the above problems, and an object of the present invention is to obtain an image processing apparatus and an image forming apparatus capable of creating a photo frame having a good design according to a photograph.

The image processing apparatus according to the present invention includes a person portion detecting unit that detects the whole person or a face portion in a photographic image read from a photograph of a paper medium as a person portion, and the person detected by the person portion detecting unit. The contour of the portion is specified, and the contour of the person portion and the inside of the contour are set as a window-shaped area, or the outer edge line outside the contour of the person portion and the inner side of the outer edge line is a window-shaped area. In the window type setting unit set to, and the background image desired by the user, the window type region is arranged at a position corresponding to the position of the window type region in the photographic image, and the window type region is made blank. A frame image generation unit that generates a photo frame image, and a photo frame assembly instruction corresponding to the background image are printed together with the photo frame image on a printing device, and the photo frame image is printed. A control unit that prints an image showing the arrangement position of the photograph on the back surface of the printing paper by the printing apparatus is provided. The person portion detection unit identifies a person detection exclusion area in the photographic image based on a user operation, does not detect the entire person or face portion in the person detection exclusion area as the person portion, and the window type setting unit Does not set the window-shaped region for the detected person when the size of the face portion of the detected person portion is equal to or smaller than a predetermined size.

An image forming apparatus according to the present invention includes the image processing apparatus described above and a printing apparatus that prints the photo frame image described above.

According to the present invention, it is possible to create a photo frame having a good design according to a photograph.

The above and other objects, features and advantages of the present invention will become more apparent from the following detailed description in conjunction with the accompanying drawings.

FIG. 1 is a block diagram showing the configuration of the image forming apparatus according to the embodiment of the present invention. FIG. 2 is a diagram showing an example of a photographic image. FIG. 3 is a diagram showing an example of a window type area set by the image processing apparatus 13 in FIG. FIG. 4 is a diagram showing an example of a photo frame image generated by the image processing device 13 in FIG. FIG. 5 is a diagram showing another example of a photographic image. FIG. 6 is a diagram showing an example of the person detection exclusion area set in the second embodiment.

Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

Embodiment 1.

FIG. 1 is a block diagram showing the configuration of the image forming apparatus according to the embodiment of the present invention. The image forming apparatus 1 shown in FIG. 1 is a copying machine, a multifunction machine, or the like.

The image forming apparatus 1 illustrated in FIG. 1 includes a printing device 11, an image reading device 12, an image processing device 13, a storage device 14, a display device 15, and an input device 16.

The printing device 11 is an internal device that prints a document image based on image data after various image processing by the image processing device 13 in an electrophotographic process using toner of CMYK (cyan, magenta, yellow, black) colors. is there.

In this embodiment, the printing device 11 prints a photo frame image on printing paper (for example, thick paper).

The image reading device 12 is an internal device that optically reads a document image from a document and generates image data of the document image as RGB data.

Further, the image processing device 13 performs image processing such as color adjustment and color conversion on the image data generated by the image reading device 12 or the like.

The storage device 14 is a rewritable nonvolatile storage device such as a flash memory and stores various data. The display device 15 displays various operation screens to the user. The input device 16 detects a user operation. For example, the display device 15 and the input device 16 are provided on the operation panel of the image forming apparatus 1, a liquid crystal display or the like is used as the display device 15, and a touch panel, a hard key, or the like is used as the input device 16. ..

The image processing device 13 is realized by an ASIC (Application Specific Integrated Circuit) or a microcomputer that executes a program, and operates as the control unit 21, the human part detection unit 22, the window type setting unit 23, and the frame image generation unit 24. ..

The storage device 14 stores the background image data 14a. The background image data 14a includes image data of a plurality of photo frame-shaped background images.

The control unit 21 controls internal devices such as the printing device 11 and the image reading device 12 to acquire an original image and print a photo frame image.

The person portion detection unit 22 detects the entire person or a face portion in a photographic image read from a paper medium photograph as a person portion.

This photographic image is read from a photograph of a paper medium as a document by the image reading device 12, for example. The control unit 21 controls the image reading device 12 to acquire image data of a photographic image from the image reading device 12. The person portion detecting unit 22 detects a person portion in the photographic image based on the image data, using existing person recognition technology, face recognition technology, or the like.

The window-type setting unit 23 specifies the contour of the human portion detected by the human-portion detecting unit 22 and sets (a) the contour of the human portion and the inside of the contour as a window-shaped region, or (b) the human portion. The outer edge line and the inner side of the outer edge line are set as the window-shaped region by a predetermined distance (for example, 3 mm) from the contour.

FIG. 2 is a diagram showing an example of a photographic image. FIG. 3 is a diagram showing an example of a window type area set by the image processing apparatus 13 in FIG.

For example, as shown in FIG. 2, when the photographic image 101 includes persons 111 and 112, the person portion detection unit 22 detects the person portion of the persons 111 and 112 in the photographic image 101, and the window type setting unit As shown in FIG. 3, the reference numeral 23 sets, in the window-shaped regions 121 and 122, the outer edge line outside the contour of the person portion by a predetermined distance and the inside of the outer edge line.

In the background image desired by the user, the frame image generation unit 24 arranges the window-type region at a position corresponding to the position of the window-type region in the photographic image, and blanks the window-type region in the background image to generate a photo frame. Generate an image.

Further, the frame image generation unit 24 reads the background image data 14a from the storage device 14, selects a background image desired by the user from the background image data 14a, and sets the window-shaped area in the selected background image as described above. A photo frame image is generated by arranging and leaving the window type region blank.

For example, the frame image generation unit 24 displays a list of a plurality of background images (for example, thumbnail images) included in the background image data 14a on the display device 15, and the list is displayed based on a user operation on the input device 16. From this, the background image selected by the user (that is, the above-mentioned background image desired by the user) is specified. The plurality of background images described above include those having the shape of a wall-mounted photo frame and those having the shape of a tabletop photo frame.

FIG. 4 is a diagram showing an example of a photo frame image generated by the image processing device 13 in FIG. A background image 211 having the shape of a wall-hanging type photo frame is used for the photo frame image 201 shown in FIG. 4, and the relative size between the photo size (the size of the photo image) and the window type regions 111 and 112 in the photo image 101. Based on such a positional relationship, the arrangement positions of the window-type regions 221 and 222 in the background image 211 corresponding to the predetermined photo positions in the photo frame (for example, the positions indicated by the dashed rectangles in FIG. 4) are specified, and As shown, a photo frame image is generated by leaving the window-type regions 221 and 222 blank.

Next, the operation of the image processing device 13 will be described.

The control unit 21 uses the image reading device 12 to acquire the image data of the photographic image 101 of the photograph to be decorated with the photo frame.

The person detection unit 22 detects a person portion in the photographic image 101 based on the image data.

The window type setting unit 23 sets the window type regions 111 and 112 based on the person portion detected in the photographic image 101. At this time, the relative positions of the window-shaped regions 111 and 112 in the photographic image (that is, the positions of the window-shaped regions 111 and 112 with respect to the outer edges and vertices of the photographic image 101) are also specified.

Then, the frame image generation unit 24 specifies the background image 211 desired by the user, and based on the shapes and positions of the window-shaped regions 111 and 112 set by the window-type setting unit 23, the frame image generation unit 24 uses the photographic image in the background image 211. The window type areas 221 and 222 are arranged at positions corresponding to the positions of the window type areas 111 and 112 in 101, and the window type areas 221 and 222 in the background image 211 are blanked to generate the photo frame image 201. ..

When the photo frame image 201 is generated in this manner, the control unit 21 prints the photo frame image 201 on the printing paper by the printing device 11.

Then, the user cuts out, for example, a photo frame image printed on a standard size printing paper at the outer edge thereof, cuts out the window-shaped regions 221, 222 to create a photo frame, and fixes the photo to the photo frame.

As described above, according to the first embodiment, the human part detecting unit 22 detects the human part in the photographic image read from the photograph of the paper medium, and the window-type setting unit 23 uses the human part detecting unit 22. The outline of the human part detected by is specified, and the outline of the human part and the inside of the outline are set as a window type area, or the outer edge line outside the outline of the human part and the inside of the outer edge line are set by the window type area. Then, the frame image generation unit 24 arranges the window-type region at a position corresponding to the position of the window-type region in the photographic image in the background image desired by the user, and makes the window-type region blank. Then, a photo frame image is generated.

This makes it possible to create a photo frame having a good design according to the photograph.

Embodiment 2.

In the second embodiment, a person detection exclusion area can be set in a photographic image.

In the second embodiment, the person part detection unit 22 specifies the person detection exclusion area in the photographic image based on the user operation, and does not detect the entire person or face part in the person detection exclusion area as the person part.

FIG. 5 is a diagram showing another example of a photographic image. FIG. 6 is a diagram showing an example of the person detection exclusion area set in the second embodiment.

For example, as shown in FIG. 5, the person 113 who appears in the photographic image 101a by accident is unnecessary for the user. Therefore, as shown in FIG. 6, for example, the user uses the input device 16 to specify a plurality of vertices 301 in the photographic image 101a to specify the person detection exclusion area 302. The person portion detection unit 22 specifies an area inside a polygon obtained by connecting the vertices 301 as a person detection exclusion area 302.

As a result, the person portion detection unit 22 detects the person portions of the persons 111 and 112 in the photographic image 101a, but does not detect the person portions of the person 113 in the person detection exclusion area 302.

As a result, the photo frame image 201 for the persons 111 and 112 is generated in the same manner as that shown in FIG.

The other configurations and operations of the image forming apparatus according to the second embodiment are the same as those in the first embodiment, and thus the description thereof will be omitted. Further, in the above-described embodiment, by designating the plurality of vertices 301 in the photographic image 101a, it is possible to prevent the window type region of an unnecessary person from being set by designating the person detection exclusion region 302. If the size of the face portion of the detected person portion is equal to or smaller than a predetermined size, the window type area for the detected person may not be set.

As described above, according to the second embodiment, it is possible to prevent the window type area of an unnecessary person in the photographic image from being set.

Embodiment 3.

In the third embodiment, the photo frame image can be printed on the transparent sheet by using the white toner in addition to the CMYK toner.

In the third embodiment, the printing apparatus 11 can perform printing using white toner in addition to CMYK toner. Then, in the third embodiment, the printing apparatus 11 does not perform printing on the window-shaped area in the photo frame image, but prints the white portion other than the window-shaped area in the photo frame image with white toner.

The other configurations and operations of the image forming apparatus according to the third embodiment are the same as those of the first or second embodiment, and thus the description thereof will be omitted.

As described above, according to the third embodiment, since the window-shaped region in the photo frame image remains transparent on the transparent sheet, the window-shaped region is cut out in the transparent sheet on which the photo frame image is printed. No need to remove. A background image desired by the user may be printed on the portion printed with white toner.

Various changes and modifications to the above-described embodiment will be apparent to those skilled in the art. Such changes and modifications may be made without departing from the spirit and scope of the subject matter and without diminishing its intended advantages. That is, such changes and modifications are intended to be covered by the appended claims.

For example, in the above-described embodiment, the control unit 21 causes the printing device 11 to display an image (for example, the above-described predetermined photo position) indicating a photo layout position on the back surface of the printing paper on which the photo frame image is printed. An image such as a frame or a registration mark) may be printed. Thereby, when the user arranges the photo of the paper medium in the photo frame based on the photo frame image generated in this embodiment, the person in the photo is accurately arranged in the window frame.

Further, in the above-described embodiment, the frame image generation unit 24 may download the background image data 14a from a server on the network for use.

Further, in the above-described embodiment, the control unit 21 may print the photo frame assembly instruction corresponding to the selected background image together with the photo frame image.

The present invention can be applied to, for example, an image forming apparatus such as a multifunction peripheral.

1 Image Forming Device 11 Printing Device 13 Image Processing Device 22 Human Part Detection Unit 23 Window Type Setting Unit 24 Frame Image Generation Unit

Claims (3)

A person part detection unit that detects the entire person or a face part in a photographic image read from a paper medium photograph as a person part,
The contour of the person portion detected by the person portion detecting unit is specified, and the contour of the person portion and the inside of the contour are set as a window-shaped area, or an outer edge outside the contour of the person portion by a predetermined distance. A window-type setting unit that sets a line and the inside of the outer edge line in a window-type region,
A frame image that generates a photo frame image by placing the window-shaped region at a position corresponding to the position of the window-shaped region in the photographic image in the background image desired by the user and leaving the window-shaped region blank. A generator,
An image indicating the arrangement position of the photo is printed on the back surface of the printing paper on which the photo frame image is printed, together with printing the photo frame assembly instruction corresponding to the background image together with the photo frame image. A control unit for printing the
Equipped with
The person part detection unit identifies a person detection exclusion area in the photographic image based on a user operation, and does not detect the entire person or face portion in the person detection exclusion area as the person portion,
The window type setting unit does not set the window type area for the detected person when the size of the face portion of the detected person portion is equal to or smaller than a predetermined size.
An image processing device characterized by . The frame image generation unit selects the background image desired by the user from the background image data of a plurality of background images in the shape of a photo frame, and in the selected background image, corresponds to the position of the window-shaped region in the photographic image. The image processing apparatus according to claim 1, wherein the photo frame image is generated by arranging the window-shaped region at a position where the window-shaped region is formed and leaving the window-shaped region blank. An image processing apparatus according to claim 1,
And before Kishirushi printing apparatus,
An image forming apparatus comprising:

Images