JP6950291B2 - Photography equipment, programs, and photography systems - Google Patents

Description

The present invention relates to a moving image creation device, a program, a photography device, and a photography system for creating a moving image from a photographed image of a user.

There are various photography devices that photograph a user and print the photographed image. Some such photography devices have a function of uploading a photographed image of a user to a server and allowing the user to download and enjoy the image.

At present, such photography devices are required to have more attractive functions that attract the interest of users. Therefore, Patent Document 1 describes a photography device that creates a moving image by fitting a photographed image of a user into a designated frame in a time-varying template.

Japanese Patent No. 5896385

However, the moving image of Patent Document 1 mainly changes the frame, and although the position, orientation, and size of the captured image can be changed between the frames, the captured image itself used during that period does not change, and a plurality of frames are used. The same captured image is used in. In addition, it was complicated to set which frame to fit the captured image in and how to change the position.

The present invention has been made in view of the above problems, and an object of the present invention is to provide a moving image creating device or the like capable of easily creating an attractive moving image from a photographed image of a user.

The first invention for solving the above-mentioned problems is an extraction means for extracting a person image from each of a plurality of captured images taken by a user, and a plurality of the plurality of the person images selected by the user. A video creation device having a compositing means for compositing each frame to create a plurality of composite images and a video creating means for creating a video for continuously reproducing the plurality of composite images by gif animation, and a user. The composite image is displayed for all the frames of the moving image, the shooting unit for shooting the image, the display unit for displaying the composite image obtained by synthesizing the user's person image during shooting in the frame selected by the user, and the composite image. possess a printer for printing, a number of users of the number of shots and the frames correspond, the person image obtained from each round of the captured image, a single frame of the plurality of the frames, the The display order in the moving image is synthesized into frames corresponding to the time-series order at the time of shooting the captured image, and the compositing means synthesizes the person image into a predetermined person area in the frame, and the person area. is a photography apparatus according to claim same position der Rukoto for all the frames.

In the present invention, a user is photographed a plurality of times, a plurality of person images extracted from each photographed image are combined into each of a plurality of frames to create a composite image, and these composite images are combined like a so-called flip book. By animating, it is possible to create an attractive moving image in which a person image changes for each frame. For example, it is possible to create a video with a story by the frame and the pose of the user at each shooting. In addition, the number of shots and the number of frames correspond, and the person image obtained from each shot image can be combined into the frame as it is in chronological order, so there is no particular need to instruct which frame the person image should be fitted into. You can easily and easily create a moving image.

It is desirable that the moving image creating device has a transmitting means for transmitting the moving image to a server.
This makes it possible to manage the video on the server and let the user download it.

It is desirable that the synthesizing means synthesizes the person image into a predetermined person area in the frame.
As described above, in the present invention, since the position of the person image is predetermined in the frame, it is not necessary to particularly instruct at which position of the frame the person image is to be combined, and the moving image can be easily created.

The second invention is an extraction means for extracting a person image from each of a plurality of photographed images taken by a user of a computer of a photography apparatus, and a plurality of frames selected by the user for the plurality of the person images. A composite means for creating a plurality of composite images by synthesizing each of the above composite images, a video creation means for creating a moving image for continuously reproducing the plurality of composite images by gif animation , and a person image of a user during shooting. A display means for displaying the composite image synthesized in the frame selected by the user on the display unit of the photography apparatus, and a printing means for printing the composite image on the printer for all the frames of the moving image. The number of shots taken by the user corresponds to the number of the frames, and the person image obtained from each shot image is one of the plurality of the frames, and the display order in the moving image. Is synthesized into frames corresponding to the captured images in chronological order at the time of shooting, the compositing means synthesizes the person image into a predetermined person area in the frame, and the person area is all. is a program characterized same position der Rukoto for said frame.

Since this photography equipment can be output as a print of the seal, such as a composite image, it is how fun that was different from the case of a moving image.

The photography device performs preview display by a display unit that displays a composite image in which a user's person image is combined with the frame during shooting, so that the user can confirm the pose according to the frame. You can take a picture to create a composite image for a moving image .

A third invention is characterized by having a photography apparatus of the first invention and a server that receives the moving image from the photography device and transmits the moving image to the terminal of the user. It is a system.
A third invention is a photography system including the photography apparatus and server of the first invention. As described above, the moving image created by the moving image creating device can be managed on the server side so that the user can download the moving image, and the storage capacity of the photography device can be prevented from being overwhelmed.

INDUSTRIAL APPLICABILITY According to the present invention, it is possible to provide a moving image creating device or the like that can easily create an attractive moving image from a photographed image of a user.

The figure which shows the photography system 1. The figure which shows the appearance of the photography apparatus 2. The figure which shows the system configuration of the photography apparatus 2. The figure which shows the hardware composition of the control device 20. The figure which shows the hardware configuration of a server 3. The flowchart which shows the process of the photography apparatus 2. An example of frameset 7. Examples of the captured image 81 and the portrait image 82. The figure explaining the composition of the person image 82 and the frame 71. The figure explaining the creation of the composite image 101-104. The figure which shows the moving image 100. Example of printed matter 110.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the drawings.

(1. Photography system 1)
FIG. 1 is a diagram showing a photography system 1 according to an embodiment of the present invention. As shown in FIG. 1, the photography system 1 of the present embodiment has a configuration in which a photography device 2, a server 3, and a user terminal 5 are communicably connected via a network 6.

The photography device 2 is for the user to take a picture of himself / herself. FIG. 2 is a diagram showing the appearance of the photography device 2, and FIG. 3 is a diagram showing the system configuration of the photography device 2.

The photography device 2 has a box-like appearance in which a user enters and takes a picture, and has a control device 20, a display unit 21, a billing unit 22, a photographing unit 23, a lighting 24, a printer 25, and a printed matter outlet 27. , The background plate 28 and the like. Other than the background plate 28, it is mainly provided on the front portion (corresponding to the left side of FIG. 2) of the photography apparatus 2.

The control device 20 is provided inside the photography device 2 and controls the entire processing of the photography device 2. In particular, in the present embodiment, the control device 20 functions as a moving image creating device that creates a moving image from a photographed image of a user according to a procedure described later.

FIG. 4 is a diagram showing a hardware configuration of the control device 20. As shown in FIG. 4, the control device 20 can be realized by, for example, a computer configured by connecting a control unit 201, a storage unit 202, an input unit 203, a communication control unit 204, and the like by a bus or the like. However, the present invention is not limited to this, and various configurations can be taken as appropriate.

The control unit 201 is composed of a CPU, ROM, RAM, and the like. The CPU calls and executes a program related to the processing of the control device 20 stored in the storage medium such as the storage unit 202 and ROM to the work area on the RAM. ROM is a non-volatile memory that permanently holds programs such as boot programs and BIOS, and data. The RAM is a volatile memory, and includes a work area used by the control unit 201 to perform various processes while temporarily holding programs and data loaded from the storage unit 202, ROM, and the like.

The storage unit 202 is a hard disk drive, a solid state drive, a flash memory, or the like, and stores a program executed by the control device 20 in a process described later, data necessary for program execution, an OS, and the like. These programs and data are read out and executed by the control unit 201 as necessary. In the present embodiment, data such as a frame set 7 described later is stored in the storage unit 202.

The input unit 203 inputs various settings to the control device 20.
The communication control unit 204 is a communication interface that mediates communication via a network or the like, and communicates with the server 3 or the like.

Returning to the description of FIGS. 2 and 3. The display unit 21 is realized by a display with a touch panel or the like that also serves as an input unit of the photography device 2. The display unit 21 displays various screens related to the user's operation / selection, and accepts the user's instruction input and the like on the screen.

The billing unit 22 is provided with a coin / banknote slot, a change return slot, a receipt outlet, a receipt printer, etc. (not shown), and manages billing and issuance of receipts from users.

The photographing unit 23 is provided with a camera or the like inside the photographing window. For example, a high-resolution digital camera is used as the camera, but the camera is not limited to this.

The lighting 24 is a lighting for photographing a user. The illumination 24 is, for example, a surface light source that irradiates white light, and is provided above the photographing unit 23, but is not limited to this.

The printer 25 prints an image and is provided inside the photography apparatus 2. The printed matter on which the image is printed is discharged to the printed matter outlet 27. The method of the printer 25 and the number of installed printers are not particularly limited.

The background plate 28 is provided at the rear portion of the photography device 2 (corresponding to the right side of FIG. 2) and serves as a background when the user takes a picture. The background plate 28 is composed of a panel of a predetermined color or the like.

Returning to the description of FIG. The server 3 is a server that receives moving images and images from the photography device 2 and manages these moving images and images.

FIG. 5 is a diagram showing an example of the hardware configuration of the server 3. As shown in FIG. 5, the server 3 can be realized by, for example, a computer configured by connecting a control unit 31, a storage unit 32, a display unit 33, an input unit 34, a communication control unit 35, and the like by a bus or the like. However, the present invention is not limited to this, and various configurations can be taken as appropriate.

The functions of the control unit 31, the storage unit 32, the input unit 34, and the communication control unit 35 are substantially the same as those of the control unit 201, the storage unit 202, the input unit 203, and the communication control unit 204 described above. Further, the display unit 33 has a display device such as a liquid crystal panel.

The storage unit 32 is composed of a hard disk drive, a solid state drive, or the like, and stores a program for causing the server 3 to execute a process described later. Further, the input unit 34 has a pointing device such as a keyboard and a mouse, and an input device such as a numeric keypad.

Returning to the description of FIG. The user terminal 5 is a computer terminal owned by the user, and for example, a smartphone, a tablet terminal, a personal computer, or the like can be used. The user terminal 5 has a control unit, a storage unit, a display unit, a communication control unit, and the like substantially the same as those described above, as well as a camera, a microphone, a speaker, and the like.

(2. Processing performed by the photography device 2)
FIG. 6 is a flowchart showing the processing of the photography apparatus 2. Each step of FIG. 6 is performed by the control device 20 of the photography device 2 executing processing in each part of the photography device 2.

In the present embodiment, the user charges the billing unit 22 at the start of shooting. When the photography device 2 receives a charge from the user (S1), the operation guidance screen (not shown) is displayed on the display unit 21 to provide operation guidance related to photography, and a frame set (template) selection screen. (Not shown) is displayed, and the selection of the frame set to be combined with the user's portrait image is accepted (S2).

FIG. 7 is an example of this frame set 7. In the present embodiment, the frame set 7 is composed of four frames (frames) 71, 72, 73, and 74, and when the frames 71 to the frame 74 are displayed in order, the dinosaurs move from the back left side to the front right side. The story is about to be attacked, and finally defeated and turned over. However, the frame set 7 is not limited to this, and any frame set 7 may be used. In the frame set 7 selection screen described above, all the frames 71 to 74 of the frame set 7 and their display order are shown so that the user can understand them.

The photography device 2 turns on the illumination 24 and photographs the user by the photographing unit 23 (S3), and the control device 20 extracts the user's person image in the photographed image (S4; extraction means).

81 of FIG. 8 is an example of a photographed image, and 82 is an example of a person image extracted from the photographed image. The portrait image 82 can be extracted by extracting a region excluding the color region a of the background plate 28 from the captured image 81.

Next, the photography device 2 synthesizes the person image 82 and the frame by the control device 20 to create a composite image (S5; compositing means).

As shown in FIG. 9, in the present embodiment, the person area b for synthesizing the user's person image 82 is predetermined at the same position for the frames 71 to 74 (frame 71 in the example of the figure). Information on the position and size of the person area b is associated with the frame set 7 and stored in advance in the storage unit 202 or the like. In S5, the composite image 101 is created by superimposing and synthesizing the person image 82 on the person area b.

In the present embodiment, the above-mentioned processes S3 to S5 are repeated until the number of times of imaging is performed according to the number of frames 71 to 74 (S6; NO). At this time, the user shoots while changing the pose, and as shown in FIG. 10, the person image 82 extracted from the second shot image 81 following the first composite image 101 created in the above procedure. The second composite image 102, which is a composite of the above in the second frame 72, the third composite image 103, which is a composite of the person image 82 extracted from the third shot image 81, and the third frame 73, and the fourth shot. A fourth composite image 104 is created by combining the portrait image 82 extracted from the image 81 into the fourth frame 74. In the present embodiment, the number of frames 71 to 74 is four, and shooting is performed four times, but the number of frames may be a plurality of frames, and the number of frames is not particularly limited. The number of shots taken by the user is not particularly limited as long as it corresponds to the number of frames.

Further, in the present embodiment, the user is photographed as a moving image during the shooting (main shooting) in S3, a person image is extracted from the image of each frame of the moving image, and as shown in 21 of FIG. The person image 82'is synthesized in the person area b of the frame (frame 72 in the example of the figure) to be combined with the person image 82 in the next captured image in the same manner as in S5, and the combined image is previewed on the display unit 21. Display it. As a result, the user can pose according to the frame, confirm it, and proceed to the main shooting.

When shooting is performed for the number of times corresponding to the number of frames 71 to 74 in this way, shooting ends (S6; YES), and the photography apparatus 2 continuously captures four composite images 101 to 104 in this order as shown in FIG. The moving image 100 to be displayed is created in a data format capable of realizing a moving image such as a gif animation or mp4 (S7; moving image creating means).

The photography device 2 transmits the moving image 100 and the composite images 101 to 104 to the server 3 (S8; transmission means), and the server 3 receives the moving image 100 and the composite images 101 to 104 and stores them in the storage unit 32. .. In S8, only the moving image 100 may be transmitted to the server 3.

Further, the photography apparatus 2 prints each of the composite images 101 to 104 on paper or the like with the printer 25 (S9), and discharges the composite images as printed matter to the printed matter outlet 27.

FIG. 12 is a diagram showing an example of the printed matter 110. The printed matter 110 is printed by arranging composite images 101 to 104 in two vertical and horizontal rows, and each composite image 101 to 104 can be peeled off as a sticker.

However, the printed matter 110 is not limited to this. For example, a photo book in which each composite image 101 to 104 is displayed on each page may be created. In addition, if the user's address and the like are registered in the server 3, goods such as photo books, T-shirts, and mugs printed with composite images 101 to 104 will be delivered to the user by mail or the like. Is also possible.

Further, the moving images 100 and the composite images 101 to 104 stored in the server 3 can be transmitted from the server 3 to the user terminal 5 in response to the access from the user terminal 5, and can be displayed and enjoyed on the user terminal 5. be. Therefore, an address, a two-dimensional code, or the like for accessing the download site of the moving image 100 or the composite image 101 to 104 may be printed on the receipt discharged from the billing unit 22 or the printed matter 110. Further, when a dedicated application or the like is started on the user terminal 5 and the printed matter 110 is read by the camera using AR (Augmented Reality) technology or the like, the moving image 100 corresponding to the printed matter 110 is downloaded from the server 3. It is also possible to reproduce on the printed matter 110 on the display unit of the user terminal 5.

As described above, according to the present embodiment, the user is photographed a plurality of times, and the plurality of person images 82 extracted from the photographed images 81 each time are combined into each of the plurality of frames 71 to 74, and the composite images 101 to 104 are combined. And animating these composite images 101 to 104 like a so-called flip book, it is possible to create an attractive moving image 100 in which the person image 82 changes for each frame. For example, it is possible to create a video 100 with a story by the frames 71 to 74 and the pose of the user at each shooting, and in the examples of FIGS. 10 and 11, the user repels the attacking dinosaur. Video 100 is created. Further, the number of shots and the number of frames 71 to 74 correspond to each other, and the person image 82 obtained from each shot image 81 can be combined with the frames 71 to 74 in chronological order as it is, so that the person image 82 is fitted into which frame. It is possible to create a moving image easily and easily without any particular instruction such as.

Further, in the present embodiment, since the created moving image 100 is transmitted to the server 3, the moving image 100 can be managed on the server 3 side so that the user can download it, and the storage capacity of the photography device 2 can be prevented from being overwhelmed. can.

Further, in the present embodiment, since the position of the person image 82 is predetermined in the frames 71 to 74, it is not necessary to particularly instruct at which position of the frames 71 to 74 the person image 82 is to be combined, and the moving image can be easily obtained. Can be created.

Further, in the present embodiment, the composite images 101 to 104 can be output as a printed matter 110 such as a sticker, so that the enjoyment can be different from that of the moving image 100.

Further, in the present embodiment, the display unit 21 of the photography apparatus 2 previews and displays a composite image in which the user's person image 82'is combined with the frames 71 to 74 during shooting, so that the user can preview the frame 71. It is possible to confirm the poses according to ~ 74 and to face the main shooting for creating the composite images 101 to 104 for moving images.

However, the present invention is not limited to this. For example, in the present embodiment, the images of frames 71 to 74 are different from each other, but some or all frames 71 to 74 may be the same image. It is also possible to give the moving image 100 a story only by the difference in the poses of the users.

Further, in the present embodiment, the person area b in the frames 71 to 74 is at the same position, but the position of the person area b in some frames may be different from the position of the person area b in other frames.

Further, on the image editing screen (not shown) displayed on the display unit 21, a line instructed by the user with a pen tool or the like, a stamp specified by the stamp tool or the like, a text input by the user, or the like is combined with the composite images 101 to 104. It is also possible to perform editing such as superimposing it on the foreground.

Further, with respect to the person image 82, as a preprocessing when synthesizing, the color of the pixel of the person image 82 is brought close to the representative color of the frame (for example, the average value or the median color between the pixels of the frame is taken). The processing may be performed, and it is also possible to reduce the discomfort at the time of synthesis. Note that "color" refers to a concept that includes chromaticity (hue / saturation) and lightness (brightness), and for the brightness and chromaticity of each pixel, for example, the RGB value of the pixel is L ^* a by a known method. ^* b ^* Can be obtained by converting to each value of the color system. In the L ^* a ^* b ^* color system, L ^* represents the brightness and a ^* and b ^* represent the chromaticity.

Further, the contour portion may be made semi-transparent by setting the α value (transparency) of the pixel of the contour portion of the person image 82 to be less than 100% and more than 0% so as to be familiar with the frames 71 to 74 at the time of compositing. .. Further, the brightness distribution of the person image 82 is corrected based on the brightness distribution of the frames 71 to 74, and the light hitting of the person image 82 is matched with the light hitting of the frames 71 to 74, so that the composite images 101 to 104 It is also possible to reduce the sense of discomfort.

Further, in S7 described above, it is also possible to transmit the composite images 101 to 104 from the photography device 2 to the server 3 and create the moving image 100 by the server 3. In this case, the control device 20 of the photography device 2 and the control device 20 The moving image creation device is configured by the server 3.

Although preferred embodiments of the present invention have been described above with reference to the accompanying drawings, the present invention is not limited to such examples. It is clear that a person skilled in the art can come up with various modifications or modifications within the scope of the technical idea disclosed in the present application, and these also naturally belong to the technical scope of the present invention. Understood.

1: Photographing system 2: Photographing device 3: Server 5: User terminal 6: Network 7: Frame set 20: Control device 21: Display unit 22: Billing unit 23: Photographing unit 24: Lighting 25: Printer 27: Printed matter Exit 28: Background plate 71, 72, 73, 74: Frame 81: Photographed image 82, 82': Person image 100: Movie 101, 102, 103, 104: Composite image 110: Printed matter

Claims (4)

An extraction means that extracts a person image from each of a plurality of captured images taken by the user,
A compositing means for creating a plurality of composite images by compositing a plurality of the person images into each of a plurality of frames selected by the user.
A video creation means for creating a video that continuously reproduces a plurality of the composite images by gif animation,
With a video creation device that has
The shooting department that shoots the user and
A display unit that displays a composite image in which a user's person image during shooting is combined with the frame selected by the user, and a display unit.
A printer that prints the composite image for all the frames of the moving image,
Have a,
The number of shots taken by the user corresponds to the number of frames,
The person image obtained from each shot image is one frame out of the plurality of the frames, and the display order in the moving image is combined with the frames corresponding to the time-series order at the time of shooting the shot images.
The combining means, the person image, synthesized human region in the frame a predetermined, the person area is photographed and wherein the same position der Rukoto for all the frames. The photography device according to claim 1, wherein the moving image creating device includes a transmitting means for transmitting the moving image to a server. The computer of the photography device,
An extraction means that extracts a person image from each of a plurality of captured images taken by the user,
A compositing means for creating a plurality of composite images by compositing a plurality of the person images into each of a plurality of frames selected by the user.
A video creation means for creating a video that continuously reproduces a plurality of the composite images by gif animation,
A display means for displaying a composite image obtained by synthesizing a user's person image during shooting in the frame selected by the user on the display unit of the photography device.
A printing means for printing the composite image on a printer for all the frames of the moving image,
And it is made to function,
The number of shots taken by the user corresponds to the number of frames,
The person image obtained from each shot image is one frame out of the plurality of the frames, and the display order in the moving image is combined with the frames corresponding to the time-series order at the time of shooting the shot images.
The combining means, the person image, synthesized human region in the frame a predetermined, the person area, the program characterized by the same position der Rukoto for all the frames. The photography apparatus according to claim 1 or 2,
A server that receives the moving image from the photography device and transmits the moving image to the user's terminal.
A photography system characterized by having.

Images