JP3195876B2 - Image data recording device - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image data recording apparatus for producing hierarchical image data by collecting image data of a predetermined image size and recording the same on an information recording medium. The present invention relates to an image data recording device that forms a frame image on an image group represented by data.

[0002]

2. Description of the Related Art A typical example of a hierarchical encoding method is described in "The Laplacian Pyramid as a C" by PJ Burt et al.
ompact Image Code ", IEEE Trans. Commun., COM-31,
No. 4, pages 532 to 540 (April 1983), a Laplacian pyramid coding method is known. This is to generate and record a reduced or enlarged image in a hierarchical file structure, as is done in a file of image data such as the Photo CD standard by Philips Kodak Company. This is disclosed in, for example, U.S. Pat. No. 4,969,204 (corresponding to Japanese Patent Publication No. 4-503295) and Japanese Patent Publication No. 4-504039.

In the Photo CD standard employing such a hierarchical coding method, for example, three primary color image data of an original image composed of 3072 × 2048 pixels read at a high resolution from a photographic film after photographing is processed. 3072 × 20 of the 0th layer
Create 16Base image data of 48 pixels. This 16Base image data is sequentially reduced, and 1024 ×
1535 pixel 4Base image data, 512 × 768 in the second layer
Pixel Base image data, 256x384 pixels in the third layer
Base / 4 image data and 128 × 192 pixels in the fourth layer
Four-layer reduced image data of Base / 16 image data is created. The reduced image data produced in this way and 16Ba
The se image data is written to a photo CD which is a writable compact disc (CD-R; Compact Disc-Recordable) through processes such as an interpolation process, an arithmetic process, and an encoding process.

Further, the reduced images represent index images arranged in a predetermined format so that the reduced images of each frame recorded on the film can be listed.
Index image data of Base image data is created. The index image data is subjected to processes such as an interpolation process, an arithmetic process, and an encoding process as described above.
Written to CD.

[0005] The image data written on the photo CD in this manner can be reproduced by a reproducing device such as a photo CD player or a CD-I player for each resolution. For example, 16Base image data is read out by a playback device, and after predetermined signal processing, is output to a printing device such as a printer to form a 16Base image of 3072 × 2048 pixels on recording paper. Is a photo cd
After a predetermined signal processing, the image is output to the television monitor, and a base image of 512 × 768 pixels is displayed on the screen.

[0006]

However, in the above-mentioned Photo CD standard, the image data is reduced by low-pass filtering and sub-sampling to produce reduced image data. In this case, index image data representing an image in which different images recorded on different frames of the photo film are arranged as one image in a predetermined format has no correlation between images at the boundary between the respective frames. There was a problem that bleeding or blurring occurred at the boundary portion of. In other words, when small images are gathered together to form one image data such as index image data and recorded on an information recording medium by a hierarchical image encoding method, data near the boundary between the small images is However, there is a problem that the border portion is blurred or blurred due to the influence of the image data adjacent to the image data which is not related at all.

The present invention solves the above-mentioned drawbacks of the prior art, and can appropriately add frame image data representing a frame image to input image data. It is an object of the present invention to provide an image data recording device capable of repairing a document by a simple method.

[0008]

According to the present invention, in order to solve the above-mentioned problems, an original image having a predetermined image size is processed to produce hierarchical image data having a plurality of image sizes. An image data recording apparatus for recording image data on an information recording medium, the apparatus processing first image data representing an original image to produce second image data of hierarchical image data composed of a plurality of layers. And a frame image synthesizing unit that synthesizes third image data representing a frame image covering a predetermined portion of the second image data created by the layering processing unit with the second image data. Processing means; and selecting means for selectively selecting the second image data and the third image data, wherein the selecting means comprises small images having different first image data in a predetermined arrangement. Was If it is the image data representing the image, and selects the third image data or the third image data synthesizable as in the second image data into the second image data.

In this case, the hierarchization processing means includes a reduction processing means for sequentially reducing the first image data in accordance with the resolution hierarchy, and the reduction processing means may filter the image data to be processed.

The hierarchical processing means includes an interpolation processing means for interpolating the second image data, a first image data and a second image data, and a second image data interpolated by the interpolation processing means. Computing means for calculating the difference between the two.

Further, the apparatus may include an encoding unit for encoding the combined image data.

Further, the frame image synthesizing processing means includes frame image generating processing means for generating third image data corresponding to a plurality of hierarchies, and the frame image generating processing means is provided with a predetermined image data in the second image data. It is preferable to generate third image data representing a frame image of a predetermined color covering the portion.

The information recording medium on which image data of a predetermined image size is recorded is preferably an optical disk.

In this case, the optical disk may include a compact disk on which data can be written.

[0015]

According to the image data recording apparatus of the present invention, the first image data representing the original image is processed by the hierarchical processing means to produce the second image data of the hierarchical image data composed of a plurality of layers. Is done. Third image data representing a frame image covering a predetermined portion of the second image data is generated by the frame image synthesis processing means, and is synthesized with the second image data. At this time, when the first image data is image data representing images composed of different small images in a predetermined arrangement, the second image data is combined with the third image data so that the third image data can be combined with the second image data. Or the third image data is selected by the selection means. Thus, image data in which the first image data is appropriately combined with the third image data representing the frame image can be recorded on the information recording medium.

[0016]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An embodiment of an image data recording apparatus according to the present invention will be described in detail with reference to the accompanying drawings. FIG. 1 shows an embodiment of an image data recording apparatus to which the present invention is applied. Referring to FIG. 1, the image data recording device 10 converts input image data into a hierarchical image data structure including a plurality of layers (0th to 4th layers) for each predetermined resolution. An image data recording apparatus for compressing and encoding image data of a resolution and recording the encoded image data on an information recording medium constituted by an optical disk such as a writable compact disk (CD-R). In particular, this image data recording device
10, image data recording that can be added to the input image data G ₀ representing the index images a collection of reduced images of a plurality of frames, the data of the frame image representing the boundary of each frame in the boundary portion of each frame Device. In FIG. 1, the image data recording device 10 is merely an example for explaining the present invention, and for convenience of explanation, FIG. 2 shows only necessary parts, and shows other parts not directly related to the present invention. Are not shown.

The image data recording apparatus 10 converts a input image data into a hierarchical image data and adds a frame image data, and encodes the data processed by the hierarchical processing circuit 12. And an encoding circuit 14.
Specifically, the hierarchical processing circuit 12, the input image data G ₀ are sequentially reduction processing, the hierarchical image data (Gaussian plane) G ₀ ~G image reduction process unit 1 _m (1 ₁ ~ to produce the _M-1 1
_M-1 ), a frame addition processing unit 2 _m (2 ₁ to 2 _M-1 ) for generating frame image data which is hierarchical image data representing a frame image in each layer of the hierarchical image data, and an image reduction process. part 1 hierarchical image data produced by _m G ₀ ~G _M-1 and the selection processing section 3 _m for alternatively selecting the frame image data generated in the frame addition processing section 2 _m (3 ₁ ~ and 3 _M-1), and the interpolation processing unit 4 _m which enlarges the hierarchical image data selected by the selection processing unit _{3 m (4 1 ~4 M-} 1), is selected in the selection processing section 3 _m Difference data (Laplacian plane) L ₀ between the hierarchical image data and the image data processed by the interpolation processing unit 4 _m .
L calculator _{5 m (5 0 ~5 M-} 2) for calculating the _M-2 and a. In this specification, the uppercase symbol "M"
It represents the number of layers in the hierarchical image data structure.

The image reduction processing section 1 _m receives input image data G ₀
And a low-pass filtering function for two-dimensionally filtering the high-frequency components of the image data. The image reduction processing unit 1 _m includes a sub-sampling unit configured to generate image data in units of blocks of n × n pixels (n is a natural number) Is a processing unit that converts image data into image data of one pixel. The image reduction processing unit 1 _m has a low-pass filter as a pre-filter for preventing aliasing distortion of the input image data input to the input 100, thereby sampling the signal band of the input image data. Limit to half the frequency. The image reduction processing unit 1 _m performs two-dimensional sampling (sub-sampling) on the input image data whose band is limited, and reduces the image size to 1 / n in both the vertical and horizontal directions.

The image reduction processing section 1 _m (1 ₁
To 1 _M−1 ) are sequentially stored in a plurality of hierarchical image data G _m (G ₁ to G ₁ ).
G _M-1 ). Image reduction processing unit 1 of each layer
_m, the hierarchical image data G _m (G _{1 to} G _M-1 )
It constitutes a conceptual Gaussian pyramid with image data G _0.

The image reduction processing unit 1 _m will be described in more detail. The image reduction processing unit 1 _m is an image of a 16Base image composed of, for example, 3072 × 2048 pixels based on the Photo CD standard input to the input 100. The data is sequentially reduced to produce image data in which the vertical and horizontal pixels are each reduced to half the number of pixels. Thereby, the image reduction processing unit 1 _m respectively converts the input 16Base image data
1536 × 1024 pixels, 768 × 512 pixels, 384 × 256 pixels and 19
The reduced image data of the 4Base image, the Base image, the Base / 4 image and the Base / 16 image of 2 × 128 pixels is created. The image reduction processing unit 1 _m outputs the produced reduced image data
Output to 102-108, these outputs 102-108 are respectively connected to one input terminal of the switching means 3 _m.

Further, the input 100 of the image reduction process unit 1 _1, for example, the index image data G ₀ representing the index image G ₀ in Photo CD standards, such as shown in FIG. 2 as the input image data. In detail, the index image data G ₀ is image data representing an image arranged and arranged in such a manner that images of a plurality of different frames formed on a photographic film can be listed in this embodiment,
The index image data G ₀ is composed of, for example, in each of the reduced images of the image recorded on the photo CD.
Therefore, by reproducing the index image data G _0, the operator can grasp the image content of each frame recorded on the photo CD.

The index image data G ₀ is 3072 ×
2048 is configured by 16Base image data configured by pixel, the image reduction processing unit 1 _m with respect to the index image data G ₀ is to produce a reduced image data in each layer as described above. However, particularly in the boundary portion between the image of each frame of the low-pass filtering processed in the reduced image, as the reduced image data G ₁ immediately after the example input image data G ₀ shown in FIG. 2 is reduction processing , Blurring and bleeding occur. In this embodiment comprises a frame addition processing unit 2 _m for generating frame image data W _m representing the frame image W ₁ for covering the blurring or bleeding portion.

The frame addition processing unit 2 _m Returning to Figure 1, the frame image W _m to be added to the index image (W ₁ ~W _M-1) frame image data W _m representing the (W ₁ ~W _M-1) Is generated for each layer, and the generated frame image is reduced to a reduced image G _m (G
_{1 to} G _M-1 ). More specifically, the frame addition processing unit 2 _m converts the frame image data W _m representing the frame image W _m for masking the blur associated with the reduction processing occurring at the boundary of the image data reduced by the image reduction processing unit 1 _m . Generate. The frame addition processing unit 2 _m generates, for example, frame image data W _m having an image size corresponding to the number of pixels in each layer.

In the present embodiment, the form of the generated frame image is a square shape for filling the boundary between a plurality of images constituting the image. The shape of the square, the structure of the original image G ₀ of the image input to the first stage of the processor, that is configured in the form of a plurality of images, the form of arrangement of each image into a shape according to the type and number of constituent picture size Is set. The width of the frame forming the square is set to a size necessary and sufficient to mask (blur) a blur generated at a boundary between images by the image reduction process. Further, the color of the frame image itself is set to an arbitrary color such as black, blue, and white. The configuration for generating such frame image data W _m may be provided as it is in the frame addition processing unit 2 _m , but in the present embodiment, the frame image data thus generated is
Write to a storage element such as ROM (Read Only Memory). The frame addition processing section 2 _m is provided with a ROM (not shown) in which frame image data W _m for each layer is written.

The frame addition processing unit 2 _m includes the hierarchical image data G _m (G ₁ -G ₁₎ reduced by the image reduction processing unit 1 _m .
G _M−1 ) has a function of combining and adding the generated frame image data W _m . The combining function removes the image data of the portion corresponding to the frame portion in the reduced image data, it may be configured to synthesize the frame image data W _m representing the frame image W _m in the area. In this case, the hierarchical image data G _m (G ₁ -G ₁₎ reduced by the image reduction processing unit 1 _{m is} processed.
G _M-1 ), and the hierarchical image data selected by the selection processing unit 3 _m described later is stored in a predetermined image data storage circuit that stores the image data G _{1 to} G _M-1 in the Gaussian pyramid. Is done. In FIG. 1, this image data storage circuit is not shown in order to avoid complication of the drawing. Frame addition processing unit 2 _m, based on the image data storage circuit for storing address of the not shown, performs synthesis processing, for example, as shown in FIG. 2, the frame image data W ₁ to the reduced image data G ₁ The hierarchical image data G ₁ a representing the synthesized image is created. The frame addition processing unit 2 _m generates the frame image data W _m
Are output to outputs 110 to 116, respectively, to perform the synthesizing process. The outputs 110 to 116 of the frame addition processing unit 2 _m are respectively connected to the other input terminals of the selection processing unit 3 _m .

The selection processing unit 3 _m includes an image reduction processing unit 1 _m
Hierarchical image data G _m, including thumbnail image data of the reduced processed each hierarchy at (G ₀ ~G _M-2) and the frame image data generated by the frame addition processing unit 2 _m frame area W _m (W _{0 to} W _M−2 ). For details, select processing unit 3 _m
It has an input terminal which the output of the image reduction process unit 1 _m each hierarchical image data G _m is connected to the input 102-108
If, alternatively selecting the input terminal 110 to 116 that output of the frame addition processing unit 2 _m each frame image data W _m is connected is input. Selection processing section 3 _m connects the input terminal selected output terminals 120-126.

The selection processing section 3 _m in this embodiment has an input terminal for outputting the reduced image data subjected to the reduction processing to the output terminals 120 to 126, for example, when the image reduction processing section 1 _m executes the reduction processing. Select
The selection processing unit 3 _m, at the time of synthesizing the frame image data W _m to the reduced image data by the frame addition processing unit 2 _m, the frame addition processing unit respectively outputs the generated frame image data W _m at 2 _m Input terminals are selected to output to terminals 120-126.
Therefore, the selection processing section at 3 _m by performing the connection switching, the function of the frame addition processing unit 2 _m for combining the frame image data W _m to the reduced image data Gm at each hierarchy is valid or invalid.

Image data output to each output terminal of the selection processing unit 3 _m is conceptual Gaussian composed of hierarchical image data G _m (Gaussian plane G _m ) for each of a plurality of resolutions as shown in FIG. Construct a pyramid. Output terminals 120 to 126 of the selection processing unit 3 _m are connected to an interpolation processing unit 4 _m and a computing unit 5 _m as shown in FIG.

The interpolation processing unit 4 _m is subjected to reduction processing by the image reduction processing unit 1 _m , and is further processed by the frame addition processing unit 2 _m.
W ₁ hierarchical image data G _m the frame image data W ₁ was synthesized to represent a processing unit for interpolating, respectively. Interpolation processing unit 4 _m
Enlarges the image data G _m each pixel by adding the n × n number of "0" data is interpolated into n × n times the image of the certain layer. For example, when the 2 × 2 pixel data is reduced to one pixel data by the image reduction processing unit 1 _m , the interpolation processing unit 4 _m adds “0” data to each pixel and performs the reduction processing. One pixel data is interpolated into 2 × 2 pixel data. The interpolated image data has an image size having the same number of pixels as the image G _m-1 of the lower hierarchy, respectively.
This image data is input to the arithmetic unit 5 _m-1 in the lower hierarchy. This interpolation processing is performed to obtain difference data from the image data of the next lower hierarchy, and the image data reduced by the image reduction processing unit 1 _m is the same as the image of the next lower hierarchy. Converted to image size. The numerical value to be added by interpolation is preferably a numerical value that reduces the amount of recording data and allows easy decoding, and in this embodiment, “0” is used.

The arithmetic unit 5 _m is a processing unit for calculating the difference between the data values of the two pixels. The arithmetic unit 5 _m of the m-th layer in the embodiment
In the following, the arithmetic unit 5 _m outputs the hierarchical image data
G _m is input to the plus input (+), and the image data G _{m + 1} interpolated by the interpolation processing unit 4 _{m + 1 in} the hierarchy one level higher than the m hierarchy is input to the minus input (-). Then, the difference between the two pixel data values on the same address is calculated. As a result, the arithmetic unit 5 _m obtains difference data L _m (Laplacian plane L _m ) constituting the Laplacian pyramid. The difference data L _m calculated by the arithmetic unit 5 _m has an output 130 to
136 is output to the encoding circuit 14. Similarly, the Gaussian plane G _M-1 (Laplacian plane L _M-1 ) in the highest hierarchy is also output to the output 138 of the hierarchical processing circuit 12 connected to the encoding circuit 14.

The coding circuit 14 is a coding processing circuit for coding each of the hierarchical image data produced by the hierarchical processing circuit 12. For more information encoding circuit 14 is provided with an encoder 6 _m for each encoded data outputted to the output 130-138 of the hierarchical processing circuit _{12 (6 0 ~6 M-1} ), the encoder 6 _m
Encodes the input data into a predetermined data amount using, for example, a Huffman code. Encoder 6
data coded in _{m (6 0 ~6 M-1} ) is converted into a predetermined recording format, in the present embodiment is recorded on an information recording medium such as a photo CD.

[0032] Next, the operation in the image data recording apparatus when the original image data G ₀ to be input to the image data recording apparatus 10 is an index image data G ₀ having an array of small image in this embodiment will be described below . First, input image data G ₀
Prior to the input, each of the input terminals of the selection processing section 3 _m is selected as shown, are respectively connected to the output 102 to 108 of the image reduction process unit 1 _m.

The original image data G ₀ is inputted, and the inputted original image data G ₀ is sequentially reduced to half the number of pixels by the reduction processing section 1 _m (1 ₀ to 1 _{M -1} ). is, reduced image data G ₁ ~G _M-1 that is reduced is produced. Gaussian pyramid Thereby the reduced image data G ₁ ~G _M-1 and layer 0 to 5 stages of the fourth layer are constituted by respective Gaussian plane of the original image data G ₀ (M stage) is produced, not It is stored in the illustrated image data storage circuit.

Next, the frame image data W _m representing the reduced image data G ₁ ~G _M-1 to frame images of the respective hierarchies produced are synthesized. Specifically, outputs 110 to 11 of the frame addition processing unit 2 _m
The input of the selection processing unit 3 _m is connected so as to select 6, and
The outputs of the frame addition processing unit 2 _m are output to outputs 120 to 126 of the selection processing unit 3 _m , respectively. Here, each of the hierarchical image data G _m (G _{1 to} G _M-1 ) stored in the image data storage circuit corresponds to the frame image data W _m generated by the frame addition processing unit 2 _m data of the portion is removed on the basis of the stored address, in the removed portion, the frame image data W _m generated in the frame addition processing unit 2 _m is synthesized. Processing for combining the frame image data W _m hierarchical image data G _m is the second layer from the first layer, the third layer and the fourth layer are performed in this order to a higher hierarchy.

The hierarchical image data G _{1 to} G _M-1 of the respective layers in which the frame image data W _m is synthesized are interpolated by the interpolation processing unit 4 _m , and the image size is enlarged to 2 × 2 times. Is converted into the processed image data. The interpolated image data is stored in the arithmetic unit 5 _m (5 _{0 to} 5
_M-2 ) is input to the minus input (-). On the other hand, arithmetic unit 5
_m (5 _{0 to} 5 _M-2 ), to the plus input (+), hierarchical image data G _{0 to} G _M-2 are input, respectively, and the input data and the image data input to the minus input (-) are input. Is calculated. Difference data calculated by the arithmetic unit _{5 m (5 0 ~5 M-} 2)
L _{0 to} L _M-2 and the hierarchical image data G _M-1 (L _M-1 ) of the highest hierarchy
And each of the encoder 6 _m of the encoding circuit 14 (6 _0-6
M-1 ).

The differential data L ₀ containing information corresponding to the frame image input to the encoder _{6 m (6 0 ~6 M-} 1) of the encoding circuit 14 ~L
_M-2 and hierarchical image data G _M-1 (L _M-1 ) are encoded for each layer. The encoded data is converted to a predetermined recording format by a recording device (not shown) and then written to a photo CD. Thus the hierarchical image data recorded, in order to part representing the frame image W _m is not subjected to the filtering of the reduction process, data representing a clear frame image W _m was formed and reproduced Even in such a case, no blur or blur occurs in the frame portion of the index image.

The image data produced in this way is effective when applied to an index image in a photo CD. However, the present invention is not limited to this, and is applicable when a plurality of small images are arranged in one image. The present invention is applied to devices such as an image processing device, an encoding device, and an image data recording device that handle hierarchical image data. The information recording medium on which the created hierarchical image data is recorded is not limited to optical discs such as photo CDs and mini discs. For example, magnetic recording devices such as fixed discs and floppy discs, and semiconductor memories such as IC memory cards. Any information storage medium can be used.

In the above embodiment, the frame addition processing section 2 _m adds the frame image data W _{1 to} W _M− to the reduced image data G _{1 to} G _M−1 stored in the image data storage circuit (not shown). were composed of ₁ to synthesize, is not limited to this, for example, it may be configured to provide for the selection processing section 3 _m function of adding the frame image data in a hierarchical image data.

In this case, for example, the selection processing unit 3 _m
During production of the reduced image data, at a timing reduced image data of the portion bleeding or blurring has not occurred is output from the image reduction process unit 1 _m, outputs the input image reduction processing unit 1 _m terminals 120-126 It is good to connect to output to.
Further, at the timing when the reduced image data of the portion where blurring or blurring is generated is output from the image reduction processing unit 1 _m , the selection processing unit 3 _m outputs the output of the frame addition processing unit 2 _m to the output terminals 120 to 126 to be connected to output. The switching selection function of the selection processing section 3 _m, the portion of the bleeding or blur reduced image data G ₁ ~G _M-1 is generated, can be added to frame image data W ₁ ~W _M-1.

The above embodiment is one preferred embodiment of the present invention, but the present invention is not limited to this embodiment, and various modifications can be made without departing from the gist of the present invention. For example, in the above-described embodiment, for the sake of simplicity, it has been described that encoding and recording on a photo CD are performed after calculating difference data in each layer. However, the present invention is not limited to this. After the data is completely recorded on the photo CD, the processing may be shifted to the processing of the upper image data.

[0041]

As described above, according to the present invention, the second image data of the hierarchical image data is produced from the first image data representing the original image by the hierarchical processing means, and the second image data of the second image data is generated. Third image data representing a frame image covering a predetermined portion is synthesized with the second image data by the frame image synthesis processing means. At this time, the selection means adds the third image data to the third image data.
The second image data or the third image data is selected so that these image data can be combined. Therefore, for example, when the original image data is index image data representing an image in which small images of a plurality of frames are collected and arranged,
A frame image can be added corresponding to the boundary between the images. In this case, even if the boundary portion is hierarchical image data in which "bleeding" or "blur" occurs, a frame image can be appropriately added so as to cover the blur or blur. The hierarchical image data to which the frame image thus produced has been added is recorded on an information recording medium such as an optical disk after a predetermined encoding process, and even when the recorded information is reproduced, the hierarchical image data is blurred. A reproduced image free from blurring can be obtained.

[Brief description of the drawings]

FIG. 1 is a block diagram showing an embodiment of an image data recording apparatus according to the present invention.

FIG. 2 is a diagram schematically showing an image represented by image data processed by the hierarchical processing circuit of the embodiment shown in FIG. 1;

[Explanation of symbols]

₁ 1 ~1 _M-1 image reduction process unit 2 ₁ ~2 _M-1 frame addition processing unit 3 ₁ ~3 _M-1 selection processing section 4 ₁ ~4 _M-1 interpolation processor 5 ₀ ~5 _M-2 arithmetic vessel 6 ₀ ~6 _M-2 encoder 10 image data recording device 12 hierarchical processing circuit 14 encoder

──────────────────────────────────────────────────続 き Continued on the front page (58) Field surveyed (Int.Cl. ⁷ , DB name) H04N 5/76-5/956 H04N 1/387 H04N 1/41-1/419 H04N 7/24-7 / 68

Claims (7)

(57) [Claims] An image data recording apparatus for processing an original image having a predetermined image size to produce hierarchical image data having a plurality of image sizes, and recording the produced image data on an information recording medium. A hierarchical processing unit configured to process first image data representing the original image to generate second image data of hierarchical image data including a plurality of hierarchies; Frame image synthesizing processing means for synthesizing third image data representing a frame image covering a predetermined portion in the obtained second image data with the second image data; and the second image data and the third image data. Selecting means for alternatively selecting image data, wherein the selecting means is configured to output, when the first image data is image data representing an image composed of different small images in a predetermined arrangement, Wherein said second image data 3
An image data recording apparatus for selecting the second image data or the third image data so that the image data can be combined. 2. The image data recording apparatus according to claim 1, wherein said hierarchical processing means includes reduction processing means for sequentially reducing said first image data in accordance with a resolution hierarchy. The image data recording apparatus is characterized in that the means filters the image data to be processed. 3. The image data recording apparatus according to claim 1, wherein the hierarchical processing means includes: an interpolation processing means for interpolating the second image data; and the first image data and the second image. An image data recording apparatus comprising: an arithmetic unit that calculates a difference between data and second image data interpolated by the interpolation processing unit. 4. The image data recording apparatus according to claim 1, wherein the apparatus comprises an encoding unit that encodes the combined image data. 5. The image data recording apparatus according to claim 1, wherein said frame image synthesis processing means includes frame image generation processing means for generating third image data corresponding to said plurality of hierarchies. An image data recording device, wherein the image generation processing means generates third image data representing a frame image of a predetermined color covering a predetermined portion of the second image data. 6. The image data recording device according to claim 1, wherein the information recording medium on which the image data of the predetermined image size is recorded is an optical disk. 7. The image data recording apparatus according to claim 6, wherein said optical disk includes a compact disk on which data can be written.