JP7659737B2 - Shooting System - Google Patents

Description

This disclosure relates to an imaging system that captures an image of a subject.

Conventionally, there is known a photography system that photographs a person to be photographed. Such photography systems have a housing in which the person to be photographed fits, and within this housing are installed a photography means (camera) and a light projecting unit. The person to be photographed sits on a chair within the housing while being photographed.

In conventional imaging systems, the interior of the housing is narrow, so the distance between the camera and the person being photographed is short. For this reason, in imaging systems, the person being photographed adjusts the height of their chair to align their face with the camera, but the task of adjusting the chair height for the person being photographed is cumbersome.

Mechanisms that move the camera up and down to match the position of the subject's face are also being considered, but mechanisms that move the camera up and down are expensive.

We are also considering using a wide-angle lens on the camera to capture the subject's entire body, but this could result in lens distortion in the resulting image.

JP 2019-129353 A

This disclosure has been made in consideration of these points, and aims to provide a photography system that can obtain images without lens distortion without the need to adjust the chair height or use a camera movement mechanism.

The present disclosure relates to an imaging system that includes a background board including a background body and a plurality of correction marks provided on the background body, an imaging device including a lens that obtains an image of a person to be photographed positioned in front of the background board and an image of a background, and a control unit to which the image obtained by the imaging device is sent, the control unit having a distortion correction parameter calculation unit that calculates distortion correction parameters for the image obtained from the shape of the correction mark in the background image among the images obtained by the imaging device through the lens, and a correction processing unit that performs correction processing on the image obtained by the distortion correction parameter calculation unit to obtain a corrected image.

The present disclosure relates to a photography system in which the control unit has a chromakey compositing unit that performs chromakey compositing using the corrected image obtained by the correction processing unit and a desired template selected by an operation panel to obtain a chromakey composite image.

This disclosure relates to a photography system in which the lens is a wide-angle lens with a shorter focal length than a standard lens.

The present disclosure is a photography system in which the background body of the background plate and the correction mark are of the same color family.

The present disclosure relates to an imaging system in which the distortion correction parameter calculation unit determines distortion correction parameters for the captured image from the shape of a correction mark that is closest to the person image among a plurality of correction marks.

The present disclosure relates to a photography system in which the background plate is installed on one side of an enclosure that surrounds the person being photographed.

The present disclosure relates to a background board that is placed behind a person to be photographed by a photographing device, the background board having a background body and a number of correction marks provided on the background body.

The present disclosure relates to a background plate in which the background body and the correction mark are of the same color family.

This disclosure makes it possible to obtain images without lens distortion without adjusting the chair height and without the need for a camera movement mechanism.

FIG. 1 is a diagram showing the entire imaging system according to the present embodiment. FIG. 2 is a block diagram showing the functional configuration of the imaging system. FIG. 3 is a diagram showing the arrangement of components inside the housing. FIG. 4 is a flowchart showing the photographing operation of the photographing system. FIG. 5A is a diagram showing an example of a background plate. FIG. 5B is a diagram showing a modified example of the background plate. FIG. 5C is a diagram showing a modified example of the background plate. FIG. 6 is a diagram showing image data obtained by the photographing device. FIG. 7 is a diagram showing a chromakey composite image. FIG. 8 is a diagram showing a modified example of the imaging system.

<Present embodiment>
Hereinafter, embodiments of the present disclosure will be described with reference to the drawings.
1 to 7 are diagrams showing an embodiment of an imaging system according to the present disclosure.

As shown in Figs. 1 to 3, the photography system 10 includes a housing 20 having a bottom plate 21, a top plate 22, and a side plate 23, and a partition wall 20C that divides the inside of the housing 20 into a photography space 20A and a storage space 20B. A camera (photography device), a light projector 34, an operation panel 15, a detection sensor 13, and a cashier 33 are provided on the partition wall 20C side of the storage space 20B of the housing 20. A floor surface 25 made of a metal plate is also provided on the bottom plate 21. Here, the housing 20 surrounds the person P to be photographed, which will be described later, and functions as an enclosure. The enclosure is not limited to one that surrounds the person P from the top, bottom, and entire sides, but may also surround the person P from only the front and back. Furthermore, in the storage space 20B, a printer 17 and a control unit 11 are sequentially provided from the bottom to the top on the side plate 23 side that faces the partition wall 20C.

A chair 45 for the person to be photographed P to sit on is also provided on the floor 25.

Among the above components, the operation panel 15 is used by the person P to be photographed to check the image captured by the camera 12 when the person P is facing the camera 12, and the operation panel 15 is a panel that is operated by the person P to be photographed. In this case, the operation panel 15 displays the corrected image 2 that has been trimmed by the trimming processing unit 11c, which will be described later, and the person P to be photographed can check this corrected image 2. Furthermore, the operation panel 15 can also display the chromakey composite image 5 obtained by the chromakey composite unit 11d, which will be described later.

As described above, the camera 12, light projector 34, and operation panel 15 are installed on the partition wall 20C side of the storage space 20B of the housing 20, and the side panel 23 side facing the partition wall 20C in the shooting space 20A is provided with a background board 40 for chromakey processing that cuts out the entire body of the person being photographed from the acquired photographed image.

In addition, on the partition wall 20C side within the storage space 20B of the housing 20, below the operation panel 15 as described above, the detection sensor 13 and the cashier 33 are arranged in sequence from top to bottom.

An outlet 17a for the printer 17 is also provided on the outer surface of the side panel 23 of the housing 20.

Furthermore, in addition to the control unit 11 and printer 17, a memory unit 16, printer 17, an I/O (Input/Output) unit 31, and a speaker 32 are built into the storage space 20B of the housing 20.

The camera 12 described above is a camera for photographing the person P, and is configured to obtain a still image or a moving image of the person P within the housing 20.

As shown in FIG. 2, the control unit 11 is composed of a CPU (Central Processing Unit) and RAM (Random Access Memory), and reads out various programs such as the system program, face image capture processing program, and image processing program stored in the storage unit 16, expands them into the RAM, and centrally controls the operation of each unit according to the programs. Then, the control unit 11 generates an image shot for each shot based on the images captured by the camera 12 (described later).

The camera 12 is composed of an optical lens, an optical sensor such as a CCD (Charge Coupled Device), an A/D (Analog/Digital) converter, etc., and when taking a picture, the subject image input through the optical lens is photoelectrically converted by the optical sensor to generate an image signal (analog). Then, the A/D converter obtains digital image data from the analog image signal, and outputs the digital image data to the control unit 11.

The detection sensor 13 is an optical sensor or the like that detects when a person P to be photographed enters the photographing space 10A of the photographing system 10, and outputs a detection signal to the control unit 11.

The operation panel 15 has various function keys such as a touch panel, a photo type selection switch (hereinafter, SW) for selecting the type of photo, a shooting SW for instructing the start of shooting, and a print SW for instructing the print output of the captured image, and outputs an operation signal corresponding to the operated key to the control unit 11.

The operation panel 15 also has an LCD (Liquid Crystal Display) and displays various operation screens, such as a guide screen explaining the shooting procedure and a selection screen for selecting the type of photo, in accordance with a control signal from the control unit 11. When the person P to be photographed is facing the camera 12, the operation panel 15 also displays the face image of the person P photographed by the camera 12.

The storage unit 16 stores the system program, various processing programs such as a face image capture processing program and an image processing program, and data processed by each program. The storage unit 16 also stores a number of templates (background images around the image of the person being photographed) 3 (see FIG. 5C), which will be described later.

The printer 17 prints out based on image data input from the control unit 11. The printing method used by the printer 17 is a dye-sublimation transfer method in which an image is formed by sublimating and transferring a coloring material. However, it may also be a melt transfer recording method in which a recording medium and an image receiving material are superimposed and heat is applied to transfer the recording layer of the recording medium to the image receiving layer of the image receiving material to form an image, or it may be an electrophotographic method, an inkjet method, or any other printing method. It may also be one that forms a silver halide photographic image.

The I/O unit 31 is an interface that mediates the exchange of information between the control unit 11 and the speaker 32, cashier 33, and light-projecting unit 34. It transmits control signals from the control unit 11 to the speaker 32, cashier 33, and light-projecting unit 34, and outputs signals from the speaker 32, cashier 33, and light-projecting unit 34 to the control unit 11.

The speaker 32 outputs the audio signal of the guide announcement input from the control unit 11 via the I/O unit 31.

The cashier 33 is a cash register equipped with an inlet for coins and bills, an inlet for returning change, etc. The cashier 33 detects the amount of money deposited through the inlet, calculates the amount of change, and discharges coins or bills in the calculated amount of change through the inlet to settle the fee.

The light-projecting unit 34 emits light at the timing and amount of light instructed by the control unit 11.

The camera 12 also has a built-in wide-angle lens 12a, and the camera 12 can obtain a photographed image 1 that captures almost the entire body of the person P sitting in the chair 45 through the wide-angle lens 12a (see FIG. 6). The photographed image 1 of the person P captured through the wide-angle lens 12a is sent to the control unit 11.

In this embodiment, the wide-angle lens 12a included in the camera (photographing device) 12 is a lens that can capture a wider range than a standard lens, and refers to a lens with a focal length of approximately 40 mm or less, specifically a lens with a focal length of 35 mm, 28 mm, or 24 mm.

In addition, when the person P is photographed by the camera 12, a background board 40 is placed behind the person P, so that the photographed image 1 obtained by photographing with the camera 12 includes both a person image 1A of the person P and a background image 1B of the background board 40.

As shown in FIG. 5A, the background board 40 has a color that is not typically found in the clothing of the person being photographed P, such as green or blue, so that the chromakey compositing process described below can be performed with high accuracy.

The background plate 40 also has a background body 41 and a number of correction marks 42 that are provided on the background body 41 and are used to determine the distortion correction parameters described below.

In this embodiment, the multiple correction marks 42 on the background plate 40 consist of square holes arranged in a grid pattern on the background body 41.

In FIG. 5A, when the background plate 40 is green, the background body 41 and the multiple correction marks 42 are all the same shade of green.

On the other hand, if the color of the background plate 40 is blue, the color of the background body 41 and the multiple correction marks 42 will all be the same shade of blue.

The correction marks 42 on the background plate 40 are not limited to square-shaped holes, but may be circular holes arranged in a grid pattern on the background body 41 (see FIG. 5B).

Alternatively, the correction marks 42 on the background plate 40 are not limited to square holes, but may be cross-hackings provided on the background body 41 (see FIG. 5C).

Next, the control unit 11 to which the captured image 1 is sent will be described. As shown in Figs. 2 and 6, the control unit 11 has a distortion correction parameter calculation unit 11a that calculates distortion correction parameters for the captured image 1 from the shape of the correction mark 42 in the background image 1B obtained by photographing the background board 40 from the captured image 1 obtained by the camera 12 through the wide-angle lens 12a, and a correction processing unit 11b that performs a correction process on the captured image 1 using the distortion correction parameters calculated by the distortion correction parameter calculation unit 11a to calculate the corrected image 2.

The correction processing unit 11b is also connected to a trimming processing unit 11c that trims the corrected image 2 obtained by the correction processing unit 11b to a size suitable for an identification photograph. The trimming processing unit 11c is also connected to a chromakey compositing unit 11d that performs chromakey compositing using the corrected image 2 obtained by the correction processing unit 11b and a desired template 3 selected by the operation panel 15 to obtain a chromakey composite image 5.

In this embodiment, the distortion correction parameter calculation unit 11a of the control unit 11 determines the distortion correction parameters for the photographed image 1 from the shape of the correction mark 42 in the background image 1B of the photographed image 1. In this case, the photographed image 1 is image data obtained through the wide-angle lens 12a, and lens distortion occurs due to the wide-angle lens 12a, and this lens distortion gradually increases from the center of the photographed image 1 toward the periphery.

The distortion correction parameter calculation unit 11a identifies the correction mark 42a near the person image 1A, specifically near the face position 1a of the person image 1A, from among the multiple correction marks 42 in the background image 1B of the photographed image 1. Then, the distortion correction parameter is calculated from the shape of the identified correction mark 42a. In this case, for example, if the correction mark 42 on the background board 40 is a square-shaped eye (see FIG. 5A), the distortion correction parameter calculation unit 11a calculates the distortion correction parameter that returns the shape of the correction mark 42a identified in the photographed image 1 to a square shape.

As described above, the photographed image 1 obtained through the wide-angle lens 12a has lens distortion caused by the wide-angle lens 12a, and therefore the identified correction mark 42a is similarly distorted. In this case, by performing a correction process using parameters that return the distorted correction mark 42a to a square shape, it is possible to correct the lens distortion caused by the wide-angle lens 12a for the person image 1A in the photographed image 1, particularly for the person image 1A near the identified correction mark 42a.

The distortion correction parameters thus calculated by the distortion correction parameter calculation unit 11a are used to perform correction processing on the captured image 1 in the correction processing unit 11b. As a result, the correction processing unit 11b generates a corrected image 2 obtained by correcting the captured image 1.

As described above, when the subject P operates the operation panel 15 to select a desired template 3 from the multiple templates 3 stored in the memory unit 16, the chromakey composition unit 11d of the control unit 11 performs chromakey composition of the selected template 3 and the corrected image 2.

Then, in the chromakey compositing section 11d, the template 3 and the corrected image 2 are chromakey-composited to generate a chromakey composite image 5, which is then sent from the control section 11 to the operation panel 15, where the chromakey composite image 5 is displayed (see FIG. 7).

Next, the operation of this embodiment configured as described above will be explained with reference to FIG.

First, when the person P to be photographed enters the housing 20, the detection sensor 13 detects the person P. At this time, guidance is displayed on the operation panel 15. At the same time, an announcement voice related to the photography guide is output from the speaker 32. During this time, the person P to be photographed sits on the chair 45 inside the housing 20.

Next, the fee is inserted into the cashier 33, where the amount is checked and an operation screen is displayed on the operation panel 15.

Then, as shown in Figure 4, the photographing operation is performed according to the guidance displayed on the operation panel 15.

The person P to be photographed selects the desired template 3 on the operation panel 15. In this case, multiple templates 3 that will serve as background images around the image of the person P to be photographed are stored in advance in the storage unit 16.

Next, the person P is photographed through the wide-angle lens 12a of the camera 12. In this way, the camera 12 obtains a photographed image 1 of the person P. Next, the photographed image 1 of the person P is sent from the camera 12 to the control unit 11.

First, the control unit 11 sends the captured image 1 to the distortion correction parameter calculation unit 11a, which detects the face position 1a of the person image 1A in the captured image 1. The distortion correction parameter calculation unit 11a identifies a correction mark 42a that serves as a reference for distortion correction based on the face position 1a of the person image 1A. At this time, the distortion correction parameter calculation unit 11a identifies a correction mark 42a near the face position 1a, for example, the first correction mark 42a from the face position 1a.

Next, the distortion correction parameter calculation unit 11a calculates distortion correction parameters based on the shape of the identified correction mark 42a, for example, if the correction mark 42 is made up of square holes, so that the shape of the identified correction mark 42a returns to a square shape.

Next, the captured image 1 is corrected in the correction processing unit 11b using the distortion correction parameters calculated in the distortion correction parameter calculation unit 11a to obtain a corrected image 2.

The corrected image 2 obtained in the correction processing unit 11b is then trimmed in the trimming processing unit 11c to a size suitable for an identification photograph, and the trimmed corrected image 2 is displayed on the operation panel 15, allowing the subject P to check the trimmed corrected image 2.

Next, the trimmed corrected image 2 is sent from the trimming processing unit 11c to the chromakey compositing unit 11d.

In this chromakey compositing section 11d, first, only the image of the person is extracted from the corrected image 2. Next, in this chromakey compositing section 11d, the extracted image of the person is chromakey composited with a desired template 3 preselected on the operation panel 15, and a chromakey composite image 5 is obtained.

The chromakey composite image 5 obtained by combining the corrected image 2 and the template 3 in the chromakey composite section 11d of the control section 11 is then sent from the control section 11 to the operation panel 15, and the chromakey composite image 5 is displayed on the operation panel 15.

The person P to be photographed checks the chromakey composite image 5 displayed on the operation panel 15 and operates the operation panel 15. After the operation of the operation panel 15, the control unit 11 releases the shutter a predetermined time later. This creates an image shot.

Then, a photo print is generated by the printer 17 based on the image shot of the chromakey composite image 5, and the photo print is discharged from the outlet 17a of the printer 17. Alternatively, this image shot may be sent to an external server (not shown) via the Wi-Fi router 18 and the network.

As described above, according to this embodiment, the camera 12 having the wide-angle lens 12a can be used to capture almost the entire body of the person P sitting in the chair 45, without making the housing 20 excessively large, to obtain the captured image 1, and the captured image 1 can be corrected using the distortion correction parameters to obtain the corrected image 2 in which the lens distortion has been corrected. In this case, since the wide-angle lens 12a is used for capturing the image, almost the entire body of the person P can be captured regardless of the sitting height of the person P, so that the person P does not need to adjust the height of the chair 45 or move the position of the camera 12 up or down.

Furthermore, the distortion correction parameter calculation unit 11a identifies the correction mark 42a closest to the face position 1a among the multiple correction marks 42 on the background board 40, and calculates the distortion correction parameters from the shape of this specified correction mark 42a, so that the lens distortion at the face position 1a of the person image 1A in particular in the photographed image 1 can be reliably corrected.

Furthermore, the colors of the background body 41 and the correction mark 42 of the background board 40 are the same color system, for example, blue or green, so even if the background board 40 has the correction mark 42, there is no problem with the chromakey compositing process in the chromakey compositing unit 11d of the control unit 11.

<Modification>
Next, a modification of this embodiment shown in FIG. 8 will be described.

In the above embodiment, a background board 40 is placed on one side of the housing 20, and a person P to be photographed sitting in front of the background board 40 is photographed by the camera 12. However, this is not limiting, and as shown in FIG. 8, a large background board 40 may be placed in a television studio, and multiple people to be photographed, for example, three people to be photographed, may be seated in front of the background board 40 at a distance from each other, and the three people to be photographed P may be photographed by the camera 12 with a built-in wide-angle lens 12a.

In the modified example shown in FIG. 8, a photographed image 1 is obtained by photographing three subjects P with a camera 12.

In the control unit 11, the distortion correction parameter calculation unit 11a calculates distortion correction parameters for each photographed person P based on the captured image 1 from the camera 12, in the same manner as in the embodiment described above, and the correction processing unit 11b performs correction processing using these correction parameters.

Specifically, the distortion correction parameter calculation unit 11a of the control unit 11 identifies the correction mark 42a closest to the face position 1a for each subject P in the photographed image 1, and calculates the distortion correction parameters for each subject P in the photographed image 1 from the shape of this identified correction mark 42a.

Next, in the correction processing unit 11b, using the distortion correction parameters for each photographed person P calculated by the distortion correction parameter calculation unit 11a, correction processing is performed on the photographed image 1 for each area including each photographed person P, and a corrected image 2 is calculated.

The corrected images 2, which have been corrected for each area including each person P, are cut out and merged close to each other. Therefore, no lens distortion remains in the area of each person P in the merged corrected image 2. The merged image thus formed is then chromakey composited in the chromakey composite unit 11d to obtain a chromakey composite image 5, which is used for broadcasting on TV or the like.

When multiple subjects P are seated in front of a background board 40 and photographed with a camera 12 including a wide-angle lens 12a, it is possible to photograph all of the subjects P with one camera 12, but it is possible that the wide-angle lens 12a will cause significant lens distortion in the photographed image 1. In this modified example, the lens distortion in the area including each subject P can be reliably corrected, and by combining the corrected images after correction and applying chromakey compositing processing to this combined image, a chromakey composite image without lens distortion can be obtained. This chromakey composite image can be broadcast on a TV or the like.

1 Photographed image 1A Person image 1a Face position 1B Background image 2 Corrected image 3 Template 5 Chromakey composite image 10 Photographing system 11 Control unit 11a Distortion correction parameter calculation unit 11b Correction processing unit 11c Trimming processing unit 11d Chromakey composite unit 12 Camera 12a Wide-angle lens 13 Detection sensor 15 Operation panel 16 Memory unit 17 Printer 17a Take-out port 20 Housing 21 Bottom plate 22 Top plate 23 Side plate 31 I/O unit 32 Speaker 33 Cashier 34 Light projecting unit 40 Background plate 41 Background body 42 Correction mark

Claims (5)

a background plate including a background body and a plurality of correction marks provided on the background body, the plurality of correction marks being arranged in a vertical direction and a plurality of correction marks arranged in a horizontal direction to form a grid shape;
an image capturing device for capturing an image of a person to be photographed positioned in front of the background plate and a background image, the image capturing device including a lens;
a control unit to which the captured image obtained by the imaging device is sent,
the control unit includes a distortion correction parameter calculation unit that calculates a distortion correction parameter for the captured image from the shape of the correction mark of the background image of the captured image obtained by the image capturing device through the lens;
a correction processing unit that performs a correction process on the captured image using the distortion correction parameters calculated by the distortion correction parameter calculation unit to calculate a corrected image,
The distortion correction parameter calculation unit calculates a distortion correction parameter for the captured image from a shape of a first correction mark for the person image among a plurality of correction marks in the background image of the actually captured captured image. The imaging system according to claim 1, wherein the control unit has a chromakey compositing unit that performs chromakey compositing using the corrected image obtained by the correction processing unit and a desired template selected by an operation panel to obtain a chromakey composite image. The imaging system according to claim 1 or 2, wherein the lens is a wide-angle lens having a shorter focal length than a standard lens. The photography system according to any one of claims 1 to 3, wherein the background body of the background plate and the correction mark have the same color family. The imaging system according to any one of claims 1 to 4, wherein the background plate is installed on one side of an enclosure surrounding the subject.

Images