JP3419946B2 - Image handling equipment - Google Patents

Description

Description: BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention forms a high-definition image.
Business cameras (hereinafter referred to as OA cameras)
Bonding of partial images by multiple image sensors
The present invention relates to an image handling apparatus that performs a shift process and the like. 2. Description of the Related Art Conventionally, a large number of pixel configurations are required with a small number of pixel configurations.
Handling device using a predetermined method for obtaining images by
The following OA cameras have been proposed by the applicant
Have been. [0003] That is, the predetermined technique is the object to be imaged.
Scan the image with a mirror for each partial image
Performing and capturing each captured partial image among multiple image sensors
Exposure is performed for each image sensor corresponding to each, and thus,
To paste the obtained partial images again in order
Input a multi-pixel image to be captured in a larger area
It is a technique that can be. O as an example of its use
FIG. 19 is a block diagram for explaining the configuration of the A camera.
Show. Hereinafter, this image will be described with reference to FIGS.
The configuration and operation of the OA camera as a handling device will be described.
You. In FIG. 19, a total reflection mirror 101 is
The incident light 102 is reflected in a predetermined direction to obtain an image to be captured.
The reflection angle is changed with respect to
Changing the angle of the mirror is called mirror scanning.
The mirror 1 is constructed so as to be movable.
On the optical axis 01, from the side closer to the total reflection mirror 101,
A lens unit 10 including an aperture, a focusing lens, and the like.
3. Each half mirror 104 is provided in this order.
The first CCD 105 and the second CCD 106 are two
It is arranged as a major. First CCD 105
Passed through the half mirror 104 of the incident light 102
The second CCD 106 receives the passing light 102a and receives the incident light.
102, the reflected light 10 reflected by the half mirror 104
2b can be received. Also, in FIG.
As shown, at each position of the total reflection mirror 101,
One CCD 105 includes a part of the image 200 to be captured.
Of the upper half of the partial images A, B, C, and D
Upper half images A1, B1, C1, and D1 corresponding to the area
Are exposed, and the same partial image A,
Lower half image corresponding to a substantially lower half area of B, C, and D
So that A2, B2, C2, and D2 are exposed simultaneously
The position of the two imagers
It is configured so as to be displaced from the axis by a predetermined amount.
Here, FIG. 20 illustrates an overlapping area and the like of each partial image.
FIG. Further, for example, total internal reflection at an initial angle position
The incident light 102 captured by the mirror 101 is
Output from each imager and the corresponding first
Through the process circuit 107 or the second process circuit 108
Converted to an image signal. And two as imagers
Are 752 pixels x 580 pixels
In this case, the upper half image A1 composed of 752 pixels × 580 pixels
(In FIG. 20, an area shaded by a solid line)
The lower half image A2 of the same pixel size (dotted line in FIG. 20)
100 pixels × 580 pixels)
A12 (in FIG. 20, the solid line and the dotted line
Area that overlaps the shaded area).
Input to the vertical laminating unit 109 for
You. That is, each input to the vertical bonding unit 109
In the video signal, the upper half image A1 and the lower half image A2 are uniform.
As if it were 1404 pixels x 580 pixels
Images as if they were captured by a single imager
Signal (partial image A of the imaging target image 200 shown in FIG. 20)
Corresponding). [0007] Such an operation is performed when a total internal reflection
The same process is repeated each time the error 101 is scanned.
Is done. Next, the upper half image A corresponding to the partial image A
1 and the lower half image A2 are captured,
The mirror driver 110 operates based on the instruction from the
The projection mirror 101 is at a position shifted by a predetermined angle from the initial position.
Is set to The total reflection mirror 101 is
-At the scanned position, perform the same processing again
This time, approximately the upper half of the partial image B of the imaging target image 200
In the upper half image B1 corresponding to the area of
The corresponding lower half image B2 is uniformly attached, and
A movie as if it was captured by a single imager
An image signal (a partial image of the imaging target image 200 shown in FIG. 20)
B (corresponding to B). Further, in order to capture partial images C and D,
Next, the total reflection mirror 101 is sequentially moved by a predetermined angle (
The area to be captured changes each time
By repeating the same process as above, a large picture as a whole
can get. However, what is important here is that
Each partial image (partial image A,
B, C, and D) in order to further attach
As shown in FIG.
However, the part where it was imported for the first time and vertical bonding was performed
Image A and a portion formed in the second time and formed in the same manner
In other words, the overlapping partial images such as the minute image B
In the image, a predetermined overlapping portion, that is,
20. As shown in FIG. 20, it is composed of 1404 pixels × 72 pixels.
The point is that it is configured to have an overlapping area. That is, when such superposition is performed,
First, as shown in FIG.
20 (for example, as shown in FIG.
A for temporarily holding the overlap region Ab) belonging to A
The boundary buffer 111, the contents of the boundary buffer 111
And the part of the next partial image that was captured earlier
Overlapping area with the minute image (for example, the overlapping area belonging to the partial image A)
Overlapping region (for example, a partial image) corresponding to the overlapping region Ab)
By comparing the contents of the overlap area Ba) belonging to the image B,
Find the features of the picture, ie the parts of the same picture, and
Motion vector detector 11 for detecting displacement between pictures
2. Use of the detection result to calculate the amount of deviation
The shift amount calculation unit 113 first calculates from the calculated shift amount.
Match the inserted partial image (for example, partial image A)
And the next captured partial image (for example, partial image B)
Correct the position of the image and superimpose the overlapping images correctly
Images joined together by a coordinate conversion unit 110 for
The image data is output from the output unit 114.
Note that the coordinate transformation here is a parallel movement or a rotational movement.
Yes, when the size of the target image is different
Includes conversion processing such as scaling. In this way,
Each time a mirror scan is performed, partial images that
Join together. Here, the captured overlapping partial images
The following factors may cause a shift in the mutual positional relationship between
Something like that is possible. For example, by mirror scan
The overlapping overlapping partial images are mutually predetermined
20. In other words, as shown in FIG.
It is configured to have an overlap area consisting of element x 72 pixels
As described above, the total reflection mirror
There is an error in the scan amount (predetermined angular movement amount) of -101
Or, if there is a variation,
The object (subject) changes while capturing images sequentially.
Or, on the contrary, a device for capturing camera shake etc. by the operator
Side displacement. On the other hand, the lens section 103
There are an aperture, a focus lens, etc.
The first CC as an imager to control when
The output signals of D105 and the second CCD 106 are cumulatively added.
Sent to the unit 115. A so-called cumulative addition is performed by the cumulative addition unit 115.
The processed data is sent to the CPU 116,
A control signal from the CPU 116 based on the
Driving (automatic exposure adjustment) and AF (automatic focusing)
Is driven. Here, for example, cumulative addition processing in AF
A collection of pixels that make up a CCD as an imager
The ball is divided into predetermined areas to make one area,
For each area of, the height of the image data obtained by each pixel
Focusing on frequency components and cumulatively adding those waveforms
In the contrast data (the accumulated data is large
The greater the size, the greater the contrast
). Each of the thus obtained contrasts
Data is stored in a predetermined memory (not shown)
Read each contrast data from this memory accordingly
To control the AF based on the data.
Sends a control signal to the focus lens of the lens unit 103
System. By the way, in the above-mentioned OA camera and the like,
When performing joining processing by pasting images together,
Such processing has been proposed by the present applicant. The configuration of this OA camera is shown in FIG.
As shown in FIG. 19, the contents of FIG.
9 is almost the same except for the description of 9. That is, the main difference from FIG. 19 is that FIG.
1, the image data converted by the coordinate conversion unit 110
The binarizing unit 119 binarizes the output unit 114
And output to the boundary buffer 111.
And a motion vector based on the stored binarized data.
This is the point to detect the Normally, the phase of the partial image in the overlapping area
The mutual displacement amount is calculated by the displacement amount calculation unit 113 and
To be performed in a place where the image switching position is fixed uniformly
Can be considered. For example, as shown in FIG.
At a predetermined switching location on the left end of image A, temporarily
When “1” is straddled, the partial image A is
When switching to the partial image B from the switching location of
The mutual images will be joined in the middle of "1".
Here, FIG. 23A shows the pasting of partial image A and partial image B.
Explain the case where there is no deviation during the joining process
FIG. FIG. 23A shows partial images A and B
Explanation of the case where there is no deviation in the process of bonding
FIG. 2B shows a partial image A and a partial image B.
Explains the case where there is a gap in the process of bonding with
FIG. FIG. 22A shows an output state in the joining process.
It is a time chart for explaining the outline of the state,
(B) is an explanatory view showing an image area. Less than
21A and 21B, the OA camera shown in FIG. 21 is used.
The processing operation and the like will be described. First, a mirror scan is performed at the time of imaging.
As shown in FIG. 22B, partial images A, B, C, and D
So that the data of each partial image
Are A, as shown in the output 141 of FIG.
B, C, and D are output in this order. For each partial image output in this way,
After adjusting the mutual displacement,
As the position for switching the image, within the predetermined overlapping area
No matter where you switch, you can basically join
You. Therefore, in this example, FIG.
Thus, the starting point of the partial image B and the star of the partial image C
Point, start point of partial image D, switching of partial image
Assuming the position, the area of each partial image is Ax, Bx, C
x and D. Therefore, the time chart of the X output 142
A, B, C, D output from the output 141
Ax, Bx, Cx, D for the data
As shown in FIG. 22 (b), complete lamination can be performed.
The joining of all the partial images is completed. However, the problem to be solved is
In such a configuration, the position or
Is always fixed.
There is a character at the position to change
If it has shifted, as shown in FIG.
There is a disadvantage that an image is output. sand
That is, the motion vector is detected, and the displacement amount between the partial images is calculated.
Is calculated, and coordinate transformation is performed.
During the operation of returning the position to the original position,
A bonding error occurs, causing a displacement of, for example, about one pixel.
The above problems are unavoidable if the
This was noticeable when the image was a character. According to the present invention, the image capturing described with reference to FIG.
Considering such issues of the handling device, paste partial images
If they match, they exist in the overlapping area of the partial images.
To provide an image handling device that does not cause a shift in the characteristic features
With the goal. According to the present invention, there is provided an image,
For other images that partially overlap with that one image,
The first image and the other image are superimposed and pasted together
Bonding image forming means for performing the processing, and the bonding
When forming a joined image as a result of the processing,
Use the one image for the image part to be superimposed, or
Indicates whether to use the other image or not.
Switching to perform switching control based on the form of the image
And an image handling apparatus including a control unit. According to the present invention, the joined image forming means is provided with one image.
And other images that partially overlap the one image.
And superimpose the one image and the other image and paste
Performing a bonding process, and the switching control means
When forming the joined image as a result of the
Using the one image for the image part to be superimposed,
Or whether to use the other image,
Switching control is performed based on the form of the image. Embodiments of the present invention will be described below with reference to the drawings.
It will be described with reference to FIG. FIG. 1 shows an example of the image handling apparatus according to the present embodiment.
Block diagram showing the configuration of the OA camera as
FIG. 2 is a diagram for illustrating the configuration and the like of the accumulative addition unit 115 of the present example.
FIG. 2 is a block diagram illustrating the configuration of the present example with reference to FIG.
You. The same parts as those in FIG.
And the description is omitted. Also, the main phase with the configuration of FIG.
The difference is the contrast data obtained by the accumulator 115.
In addition to the conventional method of using the data for AF control,
Features exist in the overlapping area of the partial images to be joined
Is determined, and the result is used as the joining information of the CPU 2.
The point is that the output can be made from the output terminal unit 1. Here, the determining means of the present invention
Included, predetermined predetermined feature evaluation criteria of the present invention and
Is the standard defined for the above contrast data
The joint image forming unit of the present invention includes a coordinate conversion unit 110
Boundary buffer 111, motion beltle detector 112, and
And a displacement calculating unit 113. In FIG. 2, a band-pass filter
(BPF) 115a calculates the location from the input image data.
It is intended to extract only a constant high-frequency component.
The value calculator 115b adds the negative waveform of the input signal
This is a circuit for converting to a waveform and taking the absolute value.
The arithmetic unit 115c calculates each input obtained by the absolute value arithmetic unit 115b.
The waveform is shown in a predetermined cumulative addition area 31 (FIG. 3A).
Each of the first CCD 105 and the second CCD 106 is 6
It is divided into four areas, and the divided 94 pixels × 72
One area of a pixel is hereinafter referred to as a cumulative addition area 31.
), For calculating the contrast
The data memory 115d stores the code obtained by the cumulative addition.
64 trust data are created for one CCD.
Therefore, as 128 CCDs, a total of 128
This is storage means for storing trust data. here
FIG. 3A is a view for explaining the configuration of a partial image.
FIG. 14B is a diagram illustrating the cumulative addition area.
FIG. In the above configuration, FIG.
Then, the operation of the present example will be described. In the figure, the input image data 21 is B
Only the high frequency component waveform 22 is extracted in the PF 115a
Is passed through the absolute value calculator 115b.
The waveform 23 is converted into an absolute value by the
c, the shaded portion 24 of the waveform whose absolute value has been converted
The cumulative addition is performed in each of the cumulative addition areas 31 to form one copy.
128 contrast data in total
The data is stored in the trust data memory 115d. Then, the CPU 2 executes this command as needed.
Each contrast from the trust data memory 115d.
Control data, and controls AF based on that data.
Control signal to the AE / AF driving section 117
And controls the focus lens of the lens unit 103. Further, the CPU 2 determines a partial image to be joined.
To determine if there are any features in the overlapping area
Then, the result is output from the joint information output terminal unit 1. That is, the CPU 2 determines the partial image to be joined.
As an image, for example, the overlapping area of the partial image A and the partial image B
In the area, an overlapping area Ab belonging to the partial image A (FIG.
Nos. 1 to 16 at the right end of the partial image A shown in (b)
, Corresponding to the 16 cumulative addition areas.
Focusing on the 16 contrast data
A given contrast as a given feature evaluation criterion
These 16 values are compared with the predetermined values (thresholds).
Are smaller than the contrast value of
b has no contrast, that is, a feature exists.
It is determined that there is not. As described above, the CPU 2 determines, for example, the overlapping area.
Area Ab (the same applies to other overlapping areas)
Exceeds a predetermined threshold in any of the cumulative addition areas.
Lamination is not possible because there is no contrast data.
If it is determined that it is possible, the connection information output terminal 1
Output information to that effect. According to the output signal from the joining information output terminal 1,
Information to the operator that lamination is not possible.
Information is output as an alarm. Also, bonding information output terminal
The output signal from the unit 1 is the shutter of the OA camera of this embodiment.
Such as automatically guarding the
It is also used as a control signal for the heater operation. Where ara
Is an LED in the viewfinder, for example.
It emits various sounds, such as lighting and
There is a way. On the other hand, for example, the accumulation in the overlapping area Ab
Contrast data exceeding the threshold exists in the addition area
Then, the CPU 2 determines that the bonding is possible.
In this case, the coordinate conversion unit 110 and the shift amount calculation unit 113
19, etc., in the same manner as in FIG.
It is to do the processing. In this way, one image and another image
The one image side and / or in front of the partially overlapping area
The one image and the other image are superimposed on the other image side.
It is determined in advance whether or not the features required to
To judge based on the predetermined characteristic evaluation criteria
Utilizing the determination result of the determination unit by the determination unit
Then, the one image and the other image are superimposed and pasted.
A bonding image forming means for performing a bonding process.
An image handling device can be realized. Therefore, according to this example, the overlapping of the partial images
Image features for use in superimposing and joining in regions
It has the effect of being able to determine whether or not a part exists.
It is. That is, more specifically, the overlapping area
If there are no features in the area, special circuits etc.
Without adding the
Such as alarms to inform the operator that
Information is output. Note that, in the present embodiment, the determination means is an AF
Focusing on contrast data as control data, special
Without using a dedicated circuit, the conventional accumulator 115 and C
The case where PU2 is used has been described.
Alternatively, it may be realized by configuring a dedicated circuit for the above determination.
The predetermined feature evaluation criteria include contrast data
May be realized without being limited to those related to
To be used for bonding in the overlapping area of the image
Even if it is possible to determine whether the features of the image
For example, the contents of the realized circuit and the contents of the predetermined
I don't know. In this embodiment, the presence of the characteristic portion is determined.
The first of two overlapping partial images
Target within the overlapping area belonging to the specified partial image
Although the case has been described, the invention is not limited to this.
Target in the overlapping area belonging to the embedded partial image
Or both. In this embodiment, the joining information output terminal 1
From the output of information that stitching is not possible,
Lock the shutter operation and pay attention to the operator
Used to give an alarm, etc.
The case has been described, but the present invention is not limited to this.
Regarding how to use the output from terminal section 1,
Any matter, scene, purpose, etc. is not asked. Further, the present invention provides a hardware
May be realized by using a
It may be realized in a hardware manner. The content to be described next is based on the above-described O
When bonding and joining partial images using A camera
Contains contrast data exceeding the predetermined threshold
If not, the OA camera will be
About the case of creating contrasts
It is. In the above embodiment, in the overlapping area,
When there is no contrast data exceeding a certain threshold
OA camera automatically
Locks the shutter operation of the
This is to prevent shadows from occurring. Follow
Can be stuck together with shifted images
There is a great advantage that you can prevent
Meaning that they cannot be stuck together
In this case, it was the same as the conventional case. Therefore, in this example, taking the above points into consideration,
Used for overlapping and joining in the overlapping area of partial images
To determine if there are image features for
Yes, and even if the feature does not exist,
Correct the misalignment between the minute images and paste them correctly.
The purpose is to provide an image handling device that can
I do. FIG. 4 shows an example of an image handling apparatus.
FIG. 2 is a block diagram showing the configuration of the OA camera of FIG.
The configuration of this example will be described with reference to the drawings. The same components as those in FIG.
And the description is omitted. Also, the main phase with the configuration of FIG.
The difference is that the CPU 2 etc.
Even if it is determined that there is no
In order for the processing to be performed correctly,
And positively simulate the contrast as a feature
LED11 as an auxiliary light element for the purpose of making
(Part of the marker projection means) and its LED 11
Auxiliary light drive unit 1 for controlling the timing of light emission of
2 (which is part of the marker projection means)
You. The LED 11 has a first function as an imager.
CCD 105 (or second CCD 106) can be identified
It projects light having a wavelength. LED11
Corresponds to the overlapping area of the partial images with respect to the imaging target.
OA turtle so that the light that it projects
It is provided inside the LA. The auxiliary light drive unit 12 includes a CP
From U2 that there is no feature in the overlapping area, etc.
Of the LED 11 as an auxiliary light element based on the instruction of
It controls light operation and the like. In the above configuration, FIG. 5 and FIG.
The operation of this example will be described with reference to FIGS. FIG. 5 illustrates the operation of this embodiment.
It is a time chart for the. First, the power of the OA camera (the power of the OA camera)
The ON / OFF state of the source is shown in FIG.
No. 51) regardless of whether you shoot
And the mirror scan starts. Here, in FIG.
-Scan operation status is captured at a predetermined timing
Partial images (partial images A, B, C, D,...)
Mira, labeled A, B, C, D to show the correspondence between
-As shown in the scan time chart 52, A, B,
Scan in the order of C, D, A, B, C, D, ...
Is repeated. The mirror scan time chart
At 52, a connection is made between the alphabetic characters A to D.
The “bore line” is the total reflection mirror 101 moving.
What's more, surround each alphabetic character with a "square"
For example, in the part A, the picture of the area of the partial image A
To the imager (the first CCD 105 and the second CCD 10
6). Mirror scan
Image at the timing of A in the time chart 52.
Light accumulates in the jar. This is sequentially repeated, and scanning is performed from A to B.
Then, scanning is performed from B to C, and the total reflection mirror 101 is scanned.
Each time the camera moves sequentially, the specified partial image is transferred to the imager.
It will be in the order of reflection. Thus, mirror scan
The first CCD 105 and the second CCD 105
The output 53 of the 2CCD 106 is, for example, a
After the light is output, the output of A
The exposure timing of the partial image.
Is output after a predetermined timing.
The order of B, C, D is basically unchanged. Here, suppose that the image necessary for the superposition is
Contrasts that exceed a certain threshold, for example, as features
Data must exist in the overlapping area of the partial images.
Is determined by the CPU 2, the joining information is output.
As an alarm signal 54 from the force terminal 1 (see FIG. 4),
A High signal is output. Here, the alarm
Is, for example, let the LED light in the viewfinder
There are various methods such as sounding
You. As the alarm signal 54, a High
The signal is output and the feature search can be performed several times as necessary.
Repeat, if still not found,
That is, it is determined that there is no contrast. this
In this case, when the release button is pressed (in FIG. 5,
When the release signal 55 indicates a High level
(Corresponding), at this point the contrast in the bonded area
Has been determined by the CPU 2 to be nonexistent
Therefore, the LED 11 as the auxiliary light is caused to emit light,
Create a high contrast and use this to
Laminate. The timing for causing the LED 11 to emit light
Is, as shown in the mirror scan time chart 52,
The timing 51a at which the partial image A is exposed,
LED1 at timing 51b when image B is exposed
1 emits light twice (timing causes LED 11 to emit light)
FIG. 5 shows that the auxiliary light signal 56 in FIG.
If you have one). The place where the auxiliary light (LED 11) is projected is
Since it must be an area where partial images overlap each other,
For example, as shown in FIG.
The right end 61 of the image plane, and the left end of the image plane for the partial image B
62. In this manner, each position of the partial image
Auxiliary light is projected on the display. Originally, the overlapping area between the partial images is
There is no characteristic part for bonding and contrast
There was no “sticky image”, but this
As a result, pseudo features exist,
Misalignment can be detected, resulting in misalignment
Without having to paste partial images correctly.
You. Therefore, for example, due to camera shake during operation,
The partial image A and the partial image B are in their original positions
Even if the image is shifted by Y in the vertical direction,
Laminating correctly based on light information
be able to. In this manner, one image and another image
The one image side and / or in front of the partially overlapping area
The one image and the other image are superimposed on the other image side.
It is determined in advance whether or not the features required to
To judge based on the predetermined characteristic evaluation criteria
Determination means and an imaging target corresponding to the overlapping area
On the other hand, project the marker used for the superposition
Marker projecting means for determining
Using the set result, the one image and the other image are superimposed.
Joining image forming hand to perform bonding process
Can realize an image handling device having a step and
You. Therefore, according to this example, the overlapping of the partial images
Image features for use in superimposing and joining in regions
It can be determined whether or not the
Even if there is no sign, the position between partial images
It is possible to correct the misalignment and paste correctly
Things. It should be noted that the marker of the present invention is
In the example, the light is described as LED light, but is not limited thereto.
In short, what if the imager is only identifiable
May be something. When light is used as a marker,
If the imager is only identifiable, for example,
It may be light having such a wavelength, the type of light, etc.
It doesn't matter. In the above example, the overlapping area of the partial images is
When there is no signature, the device side
The LED light to proactively control the
Create a trust, detect the misalignment between partial images,
It is possible to perform the correct bonding process without displacement
That is. However, in such a configuration, the imaging
The target shows contrast that did not exist originally
There is a case where it is output as a force image. Therefore, it is indispensable for the bonding process of the bonding.
It is important, but as an output image, unnecessary contrast,
In other words, disturbing images that should not exist
The distracting image, so that it doesn't show up
The following describes an example in which
You. The overlapping area of the partial images is
No, that is, it is determined as an area without contrast
If the area is
Image that was disturbed
Replace the image around the image with the shining part,
Return to an image that is very close to the original image and output it
To provide an interpolation unit 71 (see FIG. 7)
It is. Here, FIG. 7 shows the configuration of the interpolation unit 71.
It is a block diagram of FIG.
Indicates the output side of the output unit 114 in FIG.
Are connected to each other in a circuit-like manner.
Is shown. As another example, a binary signal is handled.
The case of an OA camera will be described next with reference to FIG.
You. Here, FIG. 8 is a diagram showing the configuration of the binarization unit 75.
FIG. 3 is a block diagram, and in FIG.
Is the output side of the output unit 114 in FIG.
Portion marked as the output side of the joining information output terminal 1
To indicate that they are in a circuit-like connection with each other.
I have. In this case, the output signal is binarized,
Light of LED 11 is superimposed on the binarized output image signal
Even though the surroundings were "black", the light hit
Only the part becomes "white" and the image differs from the original
Become. In this case, as explained in the above example,
There is no contrast in the overlap area, for example
The overlapping area between the right end of the partial image A and the left end of the partial image B
If only the area is forcibly made black, 2
In the case of value conversion, it can be handled in the same manner as in the above example. Next, the partial images are pasted together and subjected to the joining process.
For recording high density images, for example, JPEG
(Joint photography expert group) format
For devices that perform band compression based on
The case where there is no feature in the overlapping area of the image
I will tell. FIG. 9 shows the configuration of the image handling apparatus of this embodiment.
FIG. 2 is a block diagram for illustrating the configuration of the present example.
explain. Note that the same components as those in FIG.
The description is omitted. Also, the main difference from the configuration shown in FIG.
The point is that, in this example, when contrast data is obtained, J
DCT (Discrete cosin) based on PEG format
e transfer) processing (here, DCT processing is mainly
Processing to convert the sequence of
And obtained in the process of performing band compression of image data.
The point is that the DCT coefficient is used. In FIG. 9, the DCT processing unit 81
That performs DCT processing on encrypted image data
And the zigzag scanning unit 82 is arranged in the frequency domain.
Are converted from low frequency components to high frequency components.
Are serialized in the order of
The part 83 is only necessary part of the signal after the zigzag scan
Is cumulatively added to the AE data.
The contrast data for AF is obtained. Also, Huffman
The encoding unit 84 encodes the data after the zigzag scan.
It is for doing. In the above configuration, FIG.
Next, the operation of the present example will be described. First, based on the JPEG format,
A block corresponding to a block 91 of 64 pixels of 8 × 8 pixels.
DCT processing is performed on the locked data,
Number assigned individually to locked data
Decomposition is performed for each frequency in the order from 1 to 64. here
FIG. 10 (a) is based on the JPEG format.
And a block diagram of a 64 pixel block 91 of 8 × 8 pixels.
FIG. 5B is a diagram showing the data obtained by dividing the data into blocks.
FIG. 9 is an explanatory diagram for describing DCT processing for the same. The frequency of the data indicated by the number 1 is higher.
Is low and the data where the number is large is high
Frequency components. This is the zigzag scanning section
When the zigzag scan is performed by 82, numbers 1 to 6
4 are serially rearranged in order (Fig.
10 (b)). Here, the number 1 is 8 × 8
The DC component in the pixel block 91,
The frequency component increases as the number increases, as in ...
Is getting higher. Therefore, for example, a low frequency component of a signal is used.
Obtain necessary data for performing AE control
In order to achieve this, a relatively low
Cumulative addition is performed by the cumulative addition unit 83 using only the wave number component.
Thus, data for AE control is obtained. On the other hand, in the case of AF control, a relatively large
Relatively high frequency area
Cumulative addition in the cumulative addition unit 83 using only
Data is obtained. In this way, the zigzag scanning section 82
Required for the specified control as a result of zigzag scan
Only the minutes are cumulatively added by the cumulative adding unit 83, and the information is
The data is sent to the CPU 2 to drive the AE and the AF. As is clear from the above, the CPU 2
The contrast in the overlapping area of the partial images
If it is determined that there is no
Or, alternatively, project auxiliary light toward the imaged object,
By actively forming a pseudo-contrast,
It is possible to create a correct joint image without displacement. In this way, one image and one image
The other image partially overlapping the image,
And / or an image signal representing the other image
Orthogonal transformation means for obtaining orthogonal transformation data using
And the one image side of the overlapping area and / or
Overlay the one image and the other image on the other image side
To determine if the features required to
Judgment is made based on the criterion defined for the interchange data
Means for judging, and the judgment result by the judgment means
By using the one image and the other image
And a bonding image forming means for performing the bonding process.
The provided image handling apparatus can be realized. Therefore, according to this embodiment, for example, the DCT
To the criteria defined for orthogonal transform data such as coefficients
Based on the overlapping area of the partial image
To determine if there is an image feature to use for
And the feature does not exist.
Correct the misalignment between partial images and paste correctly
It can be combined. The present invention is not limited to cameras,
Other images such as linter, facsimile, film scanner, etc.
It is also applicable to an image handling device. It should be noted that the values determined for the orthogonal transform data of this example are
As a reference, in the above embodiment, DCT coefficients and the like are used.
The case of using is described, but not limited to this, for example,
DST (Discrete sine transfer) processing
Of course, it can be realized using numbers and Fourier transform coefficients.
No. FIG. 11 shows an embodiment of the present invention.
OA camera as one embodiment of an image handling apparatus according to the present invention
FIG. 3 is a block diagram showing the configuration of FIG. FIG. 13 shows a switching control procedure to be described later.
FIG. 9 is a diagram showing a circuit configuration of the stage 5;
The configuration of the OA camera according to the embodiment will be described. The same parts as those already described with reference to FIG.
The same reference numerals are given and the description is omitted. Also shown in FIG.
The main difference from the configuration is that the configuration shown in FIG.
Used for joining processing by pasting partial images
Switching of partial images to the form of features in the overlapping area
Switching control means 5 for controlling the
Is a point. In the configuration shown in FIG.
The image data subjected to the coordinate conversion at 0 is sent to the binarization unit 119.
And output through the output unit 114 after being binarized.
The binary value held in the boundary buffer 111
That motion vectors are detected based on digitized data
Is also different. Further, the joint image forming means of the present invention is provided with
Unit 110 and the like. In FIG. 13, the portions marked with are
As an input unit to the switching control means 5 in FIG.
Corresponding to the parts marked with
It shows that there is. Also, referring to FIG.
The SW 121 for replacement is input from a part and a part.
Incoming signals, namely data 125 and data 12
6 (see FIG. 15) for switching and outputting
Means, and the SW control circuit 122 includes an AND circuit 123
And a horizontal synchronization signal (HSYNC) 128 (see FIG.
15), the connection state of SW121 is changed.
The switch control signal 12 is used for switching control.
9 (see FIG. 15). The AND circuit 123
The input side of the body always outputs the partial image signal at the same timing.
Select signal (SEL
ECT) 127 (see FIG. 15) and the output unit 11
4 to be connected to the output side (corresponding to the part)
Have been. In the above configuration, FIG.
The operation of the present embodiment will be described with reference to FIG.
I will tell. FIG. 12A shows the bonding process of this embodiment.
Time chart to give an overview of the output state
FIG. 2B is a diagram for explaining an image area.
FIG. Further, in FIG.
Output 126 (for output of data in boundary buffer 111)
Response) is the above data 125 and data 126 (Fig.
15), the same reference numerals are assigned and
The image data combined by using
I do. Here, the main difference from FIG.
It is a point to utilize. First, the output 126, ie, the boundary buffer
The output in 111 is, for example, mirror image of partial image A once.
Detection of motion vector with partial image B when scanning
In order to perform this, Ar as the image information on the right end of the partial image A
For the time when the partial image B was scanned.
Must be stored in the boundary buffer 111 as data.
is there. Next, when the partial image B is scanned and comes out
At the left end of the partial image B and stored in the boundary buffer 111
Using the right end Ar of the partial image A
It is configured to detect mutual displacement and motion vectors.
Output, the partial image B is output from the output unit 114.
The boundary buffer 111 contains Ar
Therefore, the output 125 and the output 126 in FIG.
As shown, the partial image B is output from the output unit 114
At the timing, Ar is output from the boundary buffer 111.
It is. Thereafter, the output of the partial image C is sequentially performed.
The right end Br of the partial image B is output by the
Cr comes out at the timing when D comes out. Here, the important point is that the output unit 114 and the boundary
Skillfully switch the output of buffer 111 with SW121
This allows for the pasting of partial images
Thus, the image of the joint is not shifted. That is, as shown in FIG.
In the overlapping area between the partial images A and B,
Instead of switching partial images at the same time,
That's what it means. Further, regarding the timing and the like, FIG.
3, and will be described with reference to FIGS. Here, FIG.
Describes the output state in the joining process of this embodiment.
FIG. 13 is a time chart for switching control.
FIG. 9 is an explanatory diagram for describing a circuit configuration of a stage 5. Also, figure
16 is a timing for switching between the partial image A and the partial image B
FIG. 4 is an explanatory diagram for explaining a bug. In FIG. 15, a single mirror scan is performed.
The area of one partial image is captured.
The timing of the image B area scanned and output
Will be described. The image signal is scanned in the horizontal direction, and
For example, if the data of the partial image B is a horizontal synchronizing signal (HSYN)
C) At the point indicated by the falling timing 154 of 128
It is output as data 125. Here, data 1
The 25 signal waveforms are High for a character and white for a white background.
It sometimes indicates Low. Shown by data 126
The data to be stored is stored in the boundary buffer 111.
Data of the boundary of the minute image A,
5 becomes the same as the signal waveform. Next, referring to FIG.
Operations such as 7 will be described. As shown in the figure, the partial image 151 (FIG. 1)
2 (b) and a partial image 152 (FIG. 1).
2 (b) corresponding to the partial image B) in a predetermined area
I have. Here, if the horizontal synchronizing signal (HSYNC) 12
8 at the falling timing 154 shown in FIG.
Since the image 151 was uniformly switched to the partial image 152
Becomes the same as before. Therefore, in the overlapping area 153 of the partial images,
Then, even if the partial image 151 is output, the partial image 152 is
Since the output is basically the same even if the
(HSYNC) 128 falling timing 154
To be used before the output of the partial image 151 ends.
Minute earlier, the select signal (SELECT) 127
Switching at the time indicated by the rising timing 155
Basically, if you make a signal of
Is performed. However, the horizontal synchronization signal (HSYNC) 12
8 of the select signal (SELECT) 127 synchronized with
The pulse width of ow makes this select signal time dependent on each H.
Fixed as a result, the result is that the borderline is always constant.
If you use only that as a switching signal,
For the reasons described above, the joints of the partial images
Since it is linear, there is a possibility that character misalignment and steps will occur.
is there. In the present embodiment, in order to avoid this,
Control is performed as follows. Returning to FIG. 15, the description will be continued. First of horizontal synchronization signal (HSYNC) 128
The rising edge of the select signal (SELEC)
T) 127 switches from low to high, and
Timing 129a for switching from image A to partial image B
Then, the data 125 is Low, that is, there is no character.
Because it is the "white" part, at this timing unconditionally
No problem can occur with switching. Next, select signal (SELECT) 12
Timing 129 at which 7 switches from low to high
b, the data 125 is High, that is, the character is
It indicates that it exists and switches at this timing
Cause the joints to be
There is a possibility that a shift occurs in the shifted image. Then, the data 125 is converted from High
Until it becomes Low, that is, at the timing 129c
Wait until switching, then switch to the next partial image B
It is intended to be replaced. As described above, the timing for switching between partial images
Switching control means shown in FIG.
The shift and step may occur by realizing with 5.
Is gone. According to the circuit of the switching control means 5,
As shown in FIG. 17, the switching location (in FIG.
The replacement place is indicated by a broken line 201. Also, all images of "1"
(Reproduced based on the image data of the partial image A)
Will change along the right side of the character. Figure here
17 is a circuit of the switching control means 5 having the configuration shown in FIG.
To indicate where to switch image data when using
FIG. In the above embodiment, the unit having a shape like “1” is used.
It was a pure thing, but it was complicated like "2"
In the case of an unusual character, the above method will determine
May not be possible.
You. That is, in such a case, for example, the sentence
A so-called projection process for each character is performed. here
In the projection processing, for a predetermined character,
Performs each projection in the X and Y directions and detects the width
This is the processing to be performed. For example, when the character is "2", the
As shown, a rectangular area circumscribing “2” (in FIG. 18,
This circumscribed rectangular area 202 is represented by a dashed line).
Obtained as data. Outside obtained in this way
The tangent rectangle data 203 is converted to an AND circuit 123 shown in FIG.
(Circumscribed rectangle data 203
Sometimes, when the select signal is not switched,
Other configurations are described in the above embodiment.
13 is the same as that of FIG.
By doing so, it is possible to more accurately prevent image displacement.
It is. Here, FIG. 14 shows the switching in FIG.
FIG. 9 is an explanatory diagram for explaining another circuit configuration of the control means 5;
You. FIG. 18 shows a switching control procedure of the configuration shown in FIG.
Switching location of image data when using the circuit of stage 5
It is explanatory drawing for showing. That is, in the above configuration, switching is performed.
By determining the timing, as shown in FIG.
Always switch along the circumscribed rectangular area 202 of the character
So it never crosses characters,
Even if the detection error occurs, it
In order not to affect the joining state, FIG.
Prevention of misalignment with higher accuracy than the configuration using 3 etc.
Can be. In the above embodiment, the output data is binary data.
Although the description has been given of the case where the
Of course, value data may be used, and the same effect can be obtained.
You. In the above embodiment, the partial images are pasted together.
When matching, the feature part is placed in the overlapping area of the partial images.
The CPU 2 determines whether or not there is a
If the part does not exist, create a feature
Of a configuration including an LED 11 and an auxiliary light driving unit 12
However, the present invention is not limited to this.
Without the auxiliary light drive unit 12, the CPU 2
Of course, a configuration that does not perform the setting may be used. In this embodiment, each component is hardware-wise.
It may be realized using a component, or the software is not limited to this.
It may be realized by hardware. As is clear from the above description,
In the present invention, when partial images are pasted together,
The deviation of the feature existing in the overlapping area between
It has the advantage of being less likely to occur than.

BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 is an example of an OA according to an image handling apparatus of the present embodiment.
FIG. 2 is a block diagram illustrating the configuration of a cumulative addition unit according to the embodiment; FIG. 3A is a block diagram illustrating the configuration of a partial image according to the embodiment; FIG. 3B is an explanatory diagram for explaining a cumulative addition area of the embodiment. FIG. 4 is an example of an OA according to the image handling apparatus of the embodiment.
FIG. 5 is a block diagram showing the configuration of the camera. FIG. 5 is a time chart for explaining the operation of the present embodiment. FIG. 6 is an explanatory diagram for explaining a place where auxiliary light is projected in FIG. FIG. 8 is a block diagram illustrating a configuration of an example in which an interpolation unit is added in FIG. 8 FIG. 8 is a block diagram illustrating a configuration of a binarization unit in another example FIG. 9 is a diagram illustrating a configuration of an image handling apparatus of the present example FIG. 10A is an explanatory diagram showing a block of 64 pixels of 8 × 8 pixels based on the JPEG format. FIG. 10B is a DCT for the blocked data.
FIG. 11 is a block diagram showing a configuration of an OA camera as one embodiment of an image handling apparatus according to the present invention. FIG. 12 (a); joining in this embodiment FIG. 12 (b) is a time chart for explaining an outline of an output state in the processing; FIG. 13 is an explanatory view for explaining an image area; FIG. 13 is an explanatory view for explaining a circuit configuration of a switching control means in FIG. 14 is an explanatory diagram for explaining another circuit configuration of the switching control means in FIG. 11; FIG. 15 is a time chart for explaining an output state in the joining processing by the configuration in FIG. 11; FIG. 16 is a configuration in FIG. Partial image A and partial image B
FIG. 17 is an explanatory diagram for explaining the switching timing of the image data. FIG. 17 is an explanatory diagram for showing the switching position of the image data when the circuit of the switching control means having the configuration shown in FIG. 13 is used. FIG. 19 is an explanatory diagram showing a switching position of image data when the circuit of the switching control means having the configuration shown in FIG. 19 is used. FIG. 19 is a block diagram illustrating the configuration of an already proposed OA camera. FIG. FIG. 21 is an explanatory diagram for explaining an overlapping area and the like of each partial image of the conventional example shown in FIG. 21; FIG. 22 is a block diagram for explaining the configuration of another OA camera proposed previously; FIG. Other OA shown by
FIG. 22 (b) is a time chart for explaining the outline of the output state in the joining process of the camera; FIG. FIG. 23 (a); another conventional OA shown in FIG.
FIG. 23 (b) for explaining a case where there is no shift in the process of bonding the partial image A and the partial image B in the camera; FIG. 23 (b); the partial image A and the partial image in another conventional OA camera shown in FIG. In the process of bonding with B,
[Description of reference numerals] 1 Joining information output terminal 2 CPU 5 Switching control means 101 Total reflection mirror 102 Incident light 102a Passing light 102b Reflected light 103 Lens unit 104 Half mirror 105 First CCD 106 Second CCD 110 Coordinate conversion unit 200 Image to be captured

Claims (1)

(57) [Claim 1] For one image and another image that partially overlaps with the one image, the one image and the other image are overlapped and bonded. A bonding image forming unit for performing a process, when forming a bonding image as a result of the bonding process, using the one image as the overlapping image portion or using the other image; Switching control means for performing switching control based on the form of the image of the overlapping area.