JP4801009B2 - Image processing apparatus, image processing method, and program - Google Patents

Description

  The present invention relates to an image processing apparatus, an image processing method, and a program suitable for easily distinguishing a difference between a plurality of images to a user.

Games that compare two pictures and enjoy them are widely known. For example, a player looks at a paper on which two different pictures are printed, and compares the pictures to find a different place. Patent Document 1 discloses a game device that displays two pictures on a screen to search for mistakes. According to this, since this game apparatus displays both the problem image and the comparison image on the display at the same time, the player looks for an error by comparing the entire images displayed side by side. In addition, other conventional techniques such as those used in quiz programs or the like include a problem image and a comparative image that are displayed alternately every several seconds to search for an error.
JP 2005-2111287 A

  However, in the conventional method as described above, the player must view and compare the entire two images, which is not efficient. For example, constantly remembering which part of the whole image you should compare, which part you are trying to compare, and which part in the problem image corresponds to which part in the comparison image However, the burden on the player was heavy. Also, the task of comparing the two images to see the difference is not limited to the mistake-finding game. For example, when comparing two photos taken at the same angle at the same time and looking for changes, or creating similar images with reference to a certain original picture, the two images are displayed side by side By itself, it was not easy to work by recognizing what was the same and what was different.

  SUMMARY An advantage of some aspects of the invention is to provide an image processing apparatus, an image processing method, and a program that are suitable for easily distinguishing a difference between a plurality of images by a user.

  In order to achieve the above object, the following invention is disclosed in accordance with the principle of the present invention.

An image processing apparatus according to a first aspect of the present invention includes an image storage unit, a transmissive area input reception unit, a synthesis unit, and a display unit.
The image storage unit stores first image data and second image data that is different from the first image data and has the same size.
The transparent area input receiving unit receives an input for designating a position of a transparent area included in a display area having a predetermined size included in the first image data from the user.
The synthesizing unit obtains the display area and the transmission area in the second image data based on the position of the display area and the position of the designated transmission area. Furthermore, among the first image data, the image data of an area included in the display area and not included in the transmissive area, and the second image data included in the display area, and the The image data of the area included in the transmissive area is extracted and combined to generate a display image.
The display unit displays the generated display image.
As a result, the image processing apparatus synthesizes and displays other image data at an arbitrary location in the image data selected by the user. For example, the image processing apparatus replaces images at a location that the user wants to focus on among a plurality of different images that are similar to each other, or synthesizes these images at a location that the user wants to focus on by changing the enlargement / reduction ratio, hue, resolution, etc. To do. If there is a difference between these images, the image portion of the place of interest in the displayed image changes before and after the synthesis. The user can freely change the place of interest in the entire image. This makes it easy for the user to find differences at any location between the multiple images. The user can compare the images as if they were to see only a desired portion of a plurality of images as a watermark. Since the user can replace only the picture of the part to be noticed and display it on the image processing apparatus, it is easy to find the difference.

The image processing apparatus may further include a display area input receiving unit that receives an input for designating a position of a display area having a predetermined size included in the first image data from a user.
As a result, the image processing apparatus displays a portion designated by the user in the entire image data. The user can freely change the portion of the entire image data that is desired to be displayed on the image processing apparatus.

The image processing apparatus stores the position of the display area and the position of the transmissive area in the first image data, and the position of the display area and the position of the transmissive area in the second image data, respectively. An area storage unit;
The combining unit may combine the image data extracted from the second image data with the position of the transmission region of the first image data based on each position stored in the region storage unit.
Accordingly, the image processing apparatus can synthesize and display the images so as not to break the correspondence relationship between the positions of the image portions to be compared.

The transparent area input receiving unit further receives an input specifying the shape of the transparent area,
The synthesizing unit may extract a portion of the designated shape corresponding to the designated position from the second image data.
As a result, the image processing apparatus synthesizes and displays other image data at a portion specified by an arbitrary position and shape in the image data by the user. Thereby, the user can easily find the difference between the plurality of images represented by the designated position and shape. The user can freely change the place and shape of interest and compare the images.

The image storage unit further stores third image data,
The image processing apparatus may further include an adjustment unit that adjusts an image by applying an image filter to the third image data, and stores the adjusted data in the image storage unit as the second image data.
As a result, in the image displayed by the image processing apparatus, a discontinuous portion is generated between the place where the user is paying attention and the place where the user is not paying attention. You can easily find differences without losing sight.

The adjustment unit may adjust the size of the third image data using a filter that enlarges or reduces at a predetermined enlargement / reduction ratio.
As a result, the image processing apparatus synthesizes and displays the original image and an image that is freely enlarged or reduced. This makes it easier for the user to find the difference by enlarging or reducing the portion of the plurality of images to be compared. For example, if an image is enlarged and displayed, it becomes easy to distinguish a difference in details, and if an image is reduced and displayed, it is easy to distinguish a difference by looking over a wide range at the same time.

When the third image data is reduced, the adjustment unit may expand the peripheral portion of the reduced image data and adjust it to the same size as the second image data.
As a result, the image processing apparatus generates an image of the peripheral portion and adjusts the size so that the size of the image that can be reduced is the same size as the original image. The image part is not lost.

When enlarging the third image data, the adjustment unit may remove the peripheral portion of the enlarged image data and adjust it to the same size as the second image data.
As a result, the image processing apparatus adjusts the size by cutting the peripheral image so that the size of the image that can be enlarged is the same size as the original image. There is no need to store the part, saving memory.

The adjustment unit may enlarge or reduce the third image data at an enlargement / reduction rate associated with the area of the transmission region in advance.
Thereby, the image processing apparatus can adjust the degree of enlargement or reduction according to the width of the image portion to be compared. For example, the image can be adjusted to a size that is easy for the user to compare.

  For example, the adjustment unit includes a filter that enlarges or reduces at a predetermined enlargement / reduction ratio, a filter that performs predetermined color conversion on the image, a filter that extracts a predetermined color from the image, a filter that adjusts the edge of the image, The third image data may be adjusted using at least one of a filter that changes the resolution of the image data. The image processing apparatus can adjust and synthesize an image using a filter based on any combination of these.

The image processing apparatus may further include a movement input receiving unit and an updating unit.
The movement input accepting unit accepts an input for designating a direction and an amount for moving the position of the display area in the first image data from the user.
When the movement input reception unit receives the instruction input, the update unit moves the position of the display region and the transmission region stored in the region storage unit in the direction by the amount calculated based on the amount. Update.
Thereby, the image processing apparatus can scroll each of the images to be compared with different movement amounts. The user can easily distinguish between images to be compared. For example, it is possible to display a plurality of images while giving a sense of perspective by moving the image portion to be compared selected by the user small and moving the portion not so large.

The image processing apparatus may further include a selection input receiving unit and a moving unit.
The selection input receiving unit selects item image data arranged in the second image data, and receives an instruction input for moving the position of the selected item image data from the user.
The moving unit moves the item image data to a position indicated by the instruction input received by the selection input receiving unit when the entire item region in which the selected item image data is displayed is included in the transparent region.
As a result, if the entire image of the object, such as an item appearing in the game, is included in the comparison target image portion selected by the user, the image processing apparatus determines the position of the object according to the user's instruction. It can be changed freely. The user can create an image by freely moving the position of the object image while comparing desired portions of the image.

An image processing method according to another aspect of the present invention is an image processing method executed by an image processing apparatus having an image storage unit, a transparent region input receiving unit, a combining unit, and a display unit, and a display region input receiving step , A transparent area input receiving step, a synthesis step, and a display step.
The image storage unit stores first image data and second image data that is different from the first image data and has the same size.
In the transparent area input receiving step, the transparent area input receiving unit receives an input from the user for designating the position of the transparent area included in the display area of a predetermined size included in the first image data.
In the combining step, the combining unit obtains a display area and a transmission area in the second image data based on the position of the display area and the position of the designated transmission area, and among the first image data, Image data of an area included in the display area and not included in the transmissive area, and image data of an area included in the display area of the second image data and included in the transmissive area; Are extracted and combined to generate a display image.
In the display step, the display unit displays the generated display image.
As a result, the image processing apparatus using this image processing method synthesizes and displays other image data at an arbitrary location in the image data selected by the user. This makes it easy for the user to find differences at any location between the multiple images. The user can compare the images as if they were to see only a desired portion of a plurality of images as a watermark. Since the user can replace only the picture of the part to be noticed and display it on the image processing apparatus, it is easy to find the difference.

A program according to another aspect of the present invention causes a computer to function as an image storage unit, a transparent area input reception unit, a synthesis unit, and a display unit.
The image storage unit stores first image data and second image data that is different from the first image data and has the same size.
The transparent area input receiving unit receives an input for designating a position of a transparent area included in a display area having a predetermined size included in the first image data from the user.
The synthesis unit obtains a display area and a transmission area in the second image data based on the position of the display area and the position of the designated transmission area, and is included in the display area of the first image data. And image data of a region not included in the transparent region and image data of a region included in the display region and included in the transparent region out of the second image data are extracted. Compositing to generate a display image.
The display unit displays the generated display image.
As a result, the program causes the computer to function as a device that synthesizes and displays other image data at an arbitrary location in the image data selected by the user. This makes it easy for the user to find differences at any location between the multiple images. The user can compare the images as if they were to see only a desired portion of a plurality of images as a watermark. Since the user can replace only the picture of the part he wants to pay attention and display on the computer, it becomes easy to find the difference.

The program of the present invention can be recorded on a computer-readable information storage medium such as a compact disk, flexible disk, hard disk, magneto-optical disk, digital video disk, magnetic tape, and semiconductor memory.
The above program can be distributed and sold via a computer communication network independently of the computer on which the program is executed. The information storage medium can be distributed and sold independently from the computer.

  According to the present invention, it is possible to make it easy for a user to distinguish a difference between a plurality of images.

(Embodiment 1)
FIG. 1 is a schematic diagram showing a schematic configuration of a typical portable game machine (game device) in which an image processing device according to an embodiment of the present invention is realized. Hereinafter, a description will be given with reference to FIG.

  The portable game machine 1 includes a processing control unit 10, a connector 11, a cartridge 12, a wireless communication unit 13, a communication controller 14, a sound amplifier 15, a speaker 16, an operation key 17, and a first display. A unit 18, a second display unit 19, and a touch panel 20 are provided.

  The processing control unit 10 includes a CPU (Central Processing Unit) core 10a, an image processing unit 10b, a VRAM (Video Random Access Memory) 10c, a WRAM (Work RAM) 10d, an LCD (Liquid Crystal Display) controller 10e, A touch panel controller 10f.

  The CPU core 10a controls the operation of the entire portable game machine 1 and is connected to each component to exchange control signals and data. Specifically, a program and data stored in a ROM (Read Only Memory) 12a in the cartridge 12 are read out with the cartridge 12 mounted in the connector 11, and predetermined processing is executed.

  The image processing unit 10b processes the data read from the ROM 12a in the cartridge 12 and the data processed by the CPU core 10a, and stores the processed data in the VRAM 10c.

The VRAM 10c is a memory for storing display information, and stores image information processed by the image processing unit 10b and the like.
The WRAM 10d stores work data and the like necessary for the CPU core 10a to execute various processes according to the program.

  The LCD controller 10e controls the first display unit 18 and the second display unit 19 to display a predetermined display image. For example, the LCD controller 10 e converts the image information stored in the VRAM 10 c into a display signal at a predetermined synchronization timing and outputs the display signal to the first display unit 18. In addition, the LCD controller 10 e displays a predetermined instruction icon or the like on the second display unit 19.

  The touch panel controller 10f detects a touch (touch) on the touch panel 20 with a touch pen or a user's finger. For example, in the state where a predetermined instruction icon or the like is displayed on the second display unit 19, a contact on the touch panel 20 and its position are detected.

  The connector 11 is a terminal that can be detachably connected to the cartridge 12, and transmits / receives predetermined data to / from the cartridge 12 when the cartridge 12 is connected.

The cartridge 12 includes a ROM 12a and a RAM (Random Access Memory) 12b.
The ROM 12a stores a program for realizing the game and image data, sound data, and the like accompanying the game.
The RAM 12b stores various data indicating the progress of the game.

The wireless communication unit 13 is a unit that performs wireless communication with the wireless communication unit 13 of another portable game apparatus 1, and transmits and receives predetermined data via an antenna (not shown) (such as a built-in antenna).
The wireless communication unit 13 can also perform wireless LAN communication with a predetermined access point. The wireless communication unit 13 is assigned a unique MAC (Media Access Control) address.

  The communication controller 14 controls the wireless communication unit 13 and mediates communication performed between the process control unit 10 and the process control unit 10 of another portable game apparatus 1 according to a predetermined protocol.

The sound amplifier 15 amplifies the audio signal generated by the processing control unit 10 and supplies it to the speaker 16.
The speaker 16 is composed of, for example, a stereo speaker, and outputs predetermined music sound, sound effect, and the like according to the audio signal amplified by the sound amplifier 15.

  The operation key 17 includes a plurality of key switches and the like appropriately arranged on the game apparatus 1 and receives a predetermined instruction input according to a user operation.

The 1st display part 18 and the 2nd display part 19 consist of LCD etc., are controlled by LCD controller 10e, and display a game image etc. suitably.
Note that the second display unit 19 displays an instruction icon or the like for inputting an operation instruction from the user by touching the touch panel 20.

The touch panel 20 is arranged so as to be superimposed on the front surface of the second display unit 19 and accepts an input by contact with a touch pen or a user's finger.
The touch panel 20 includes, for example, a pressure-sensitive touch sensor panel and the like, detects the pressure of the user's finger and the like, and detects the contact state and the transition from the contact state to the non-contact state. In addition, the touch panel 20 may detect contact with a user's finger or the like from a change in capacitance or the like.

  Next, processing performed by each unit of the image processing apparatus 200 according to the present embodiment in cooperation will be described. FIG. 2 is a diagram illustrating a functional configuration of the image processing apparatus 200. The image processing apparatus 200 includes an image storage unit 201, a display area input reception unit 202, a transmissive area input reception unit 203, an area storage unit 204, a synthesis unit 205, and a display unit 206.

  The image storage unit 201 stores a plurality of image data. In the present embodiment, the image storage unit 201 stores at least two digital image data (first image data 251 and second image data 252). These image data are stored in advance in the ROM 12a in the cartridge 12. The processing control unit 10 appropriately reads out these image data from the cartridge 12 and stores them in the VRAM 10c or the like. The processing control unit 10, the connector 11, and the cartridge 12 operate in cooperation to function as the image storage unit 201.

  For example, the image storage unit 201 stores first image data 251 and second image data 252 as shown in FIGS. The first image data 251 and the second image data 252 have the same size, that is, the vertical length Lv is the same, and the horizontal length Lh is also the same. In the present embodiment, the first image data 251 and the second image data 252 have different parts (differences) in appearance. In this example, there is a difference that there are no apples and cups on the table of the first image data 251. The differences may be partial or total.

  The display area input receiving unit 202 receives an input specifying the position of the display area 261 of a predetermined size included in the first image data 251 from the user, and displays display area information 265 indicating the position of the display area 261 as an area storage unit It is memorized in 204. The user can specify the position of the display area 261 by pressing the operation key 17 or pressing the touch panel 20 using a touch pen, for example. The processing control unit 10, the control key 17, and the touch panel 20 operate in cooperation to function as the display area input reception unit 202.

  For example, the display area 261 has a rectangular shape as shown in FIG. 4A, and a portion included in the display area 261 in the first image data 251 is displayed on the LCD of the second display unit 19. Typically, the vertical length and the horizontal length of the display area 261 are fixed values, and the position of the display area 261 in the first image data 251 is variable. The user can display the first image data 251 by changing the position of the display area 261 using the operation keys 17 or the touch panel 20. For example, a predetermined coordinate system (XY coordinate system or the like) is defined for the first image data 251 and the position of the display area 261 is determined by designating the coordinates of each vertex of the rectangle. In the present embodiment, the display area 261 is rectangular, but may be any shape.

  Note that all of the first image data 251 may be included in the display area 261. That is, the entire area of the first image data 251 may be set as the display area 261 so that the entire first image data 251 is displayed on the LCD. In this case, the image processing apparatus 200 can omit the configuration of the display area input receiving unit 202.

  The transmissive area input receiving unit 203 receives an input specifying the position and shape of the transmissive area 271 included in the display area 261 from the user, and stores the transmissive area information 275 indicating the position and shape of the transmissive area 271 in the area storage unit 204. Let The user can specify the position and shape of the transparent region 271 by pressing the operation key 17 or pressing the touch panel 20 using a touch pen, for example. The processing control unit 10, the control key 17, and the touch panel 20 operate in cooperation to function as the transmissive area input reception unit 203.

  For example, the transmissive region 271 is a figure surrounded by a curve as shown in FIG. The user can designate the transparent region 271 by drawing on the touch panel 20 using a touch pen. The processing control unit 10 corresponds to a point (or line, figure) designated by the user on the touch panel 20 based on the correspondence between the coordinate system preset on the touch panel 20 and the coordinate system preset on the display area 261. The coordinate value of the point (or line, figure) in the display area 261 is calculated, and the position of the transmissive area 271 is obtained. The user can draw an arbitrary figure on the touch panel 20, and an area (enclosed area) closed by the drawn point or line can be the transmissive area 271. Typically, a region surrounded by a line drawn with a single stroke by the user is a transmissive region 271.

  Note that the transmissive area 271 may have a predetermined shape, and the transmissive area input receiving unit 203 may receive an input designating only the position of the transmissive area 271 from the user. In this case, the transmission area information 275 stores information indicating the position of the transmission area 271 designated by the user. The predetermined shape is typically a circle, an ellipse, a square, a rectangle, or the like, and these may be used in combination. For example, a frame object having a predetermined shape serving as a boundary line of the transmissive region 271 may be prepared, and the user may move (drag) the frame object left, right, up and down using a touch pen or the like.

  The area storage unit 204 includes display area information 265 indicating the position of the display area 261 received by the display area input receiving unit 202, and transmissive area information 275 indicating the position and shape of the transmissive area 271 received by the transmissive area input receiving unit 203. And remember. The processing control unit 10 and the cartridge 12 operate in cooperation to function as the area storage unit 204.

  Based on the position of the display area 261 in the first image data 251 indicated by the display area information 265 and the position of the transmission area 271 in the first image data 251 indicated by the transmission area information 275, the combining unit 205 A display area 262 and a transmission area 272 in the image data 252 are obtained.

  Specifically, as illustrated in FIG. 4B, the processing control unit 10 defines the same coordinate system as the first image data 251 in the second image data 252, and displays the display area 261 in the first image data 251. The display area 262 in the second image data 252 is set at the same position as the position. Similarly, the processing control unit 10 sets the transmissive area 272 in the second image data 252 at the same position as the position of the transmissive area 271 in the first image data 251. The shapes of the transmission region 271 and the transmission region 272 are the same.

Furthermore, the synthesis unit 205
(1) Among the first image data 251, image data of an area included in the display area 261 and not included in the transmissive area 271;
(2) Among the second image data 252, image data of an area included in the display area 262 and included in the transmissive area 272,
Are extracted and combined to generate a display image.

  More specifically, the combining unit 205 determines whether a certain area in the first image data 251 is included in the display area 261 and whether a certain area in the second image data 252 is included in the transmissive area 272. Is determined based on the display area information 265 and the transmission area information 275 stored in the area storage unit 204, and the image data extracted from the second image data 252 is stored in the transmission area 271 of the first image data 251. Composite to position.

  FIG. 5A shows this conceptually. The image data of the area (1) described above of the first image data 251 is a portion that is shaded in the display area 261 of this figure. The image data in the above-mentioned area (2) of the second image data 252 is a part shaded in the display area 262 in this figure. The process control unit 10 synthesizes the image included in the transmissive area 272 in place of the image included in the transmissive area 271. In other words, the processing control unit 10 generates an image as if the second image data is “seen through” only in the transparent region 271 when viewed in the direction of the arrow Y1 in the drawing.

  FIG. 5B is an example of a display image 280 generated by the processing control unit 10 based on the image data represented in FIGS. 4A and 4B. In the display image 280, an apple appears in the transparent area 271. However, the cup is not included in the display image 280 because it is not in the transmissive region 271.

  In this way, the processing control unit 10 synthesizes the display image 280 using the first image data 251 and the second image data 252 stored in the VRAM 10c. The processing control unit 10 functions as the synthesis unit 205.

  The display unit 206 displays the display image 280 generated by the combining unit 205 on the LCD of the second display unit 19 (or the first display unit 18). As a result, the user can view an image synthesized from the first image data 251 and the second image data 252. The processing control unit 10 and the second display unit 19 (or the first display unit 18) operate in cooperation to function as the display unit 206.

  In addition, although the boundary part of the transmissive area | region 271 is shown by the continuous line in the display image 280 of FIG.5 (b), you may make it display a boundary line like this example, and do not display it. Also good.

  Next, image generation processing performed in cooperation with each unit of the image processing apparatus 200 according to the present embodiment will be described with reference to the flowchart of FIG.

  First, the composition unit 205 sets a display area 261 and a transmission area 271 in the first image data 251 and a display area 262 and a transmission area 272 in the second image data 252 (step S601).

That is, as shown in FIG. 7A, the composition unit 205 displays the display area in the first image data 251 based on the input specifying the position of the display area 261 received from the user by the display area input receiving unit 202. The position 261 is set, and the display area 262 is set at the same position in the second image data 252 as the set position.
Further, as shown in FIG. 7B, the composition unit 205 stores the first image data 251 in the first image data 251 based on the input specifying the position and shape of the transparent region 271 received from the user by the transparent region input receiving unit 203. The position of the transmissive area 271 is set, and the display area 272 is set at the same position in the second image data 252 as this determined position.

  Next, the synthesizing unit 205 extracts image data of an area included in the display area 261 and not included in the transmissive area 271 from the first image data 251. That is, the synthesizing unit 205 extracts image data of a part other than the transmissive area 271 from the display area 261 of the first image data (step S602).

  The synthesizing unit 205 extracts image data of an area included in the display area 262 and included in the transmissive area 272 from the second image data 252. That is, the synthesizing unit 205 extracts the image data of the transmissive area 272 from the display area 262 of the second image data (step S603).

  The synthesizing unit 205 then synthesizes the two image data extracted in steps S602 and S603 to generate a display image 280 (step S604). That is, as illustrated in FIG. 7C, the composition unit 205 arranges the image included in the transmissive area 272 in the second image data 252 in a place where the transmissive area 271 in the first image data 251 exists. Synthesize.

  The generated display image 280 is displayed on the LCD by the display unit 206. For example, when the user draws a graphic designating the transparent area 271 on the touch panel 20 while watching the screen of the first image data 251 displayed as shown in FIG. The generation process is executed to generate the display image 280, and the display unit 206 displays the display image 280 on the LCD. Since the user can freely change the position of the display area 261 and can freely change the position and shape of the transmissive area 271, the image processing apparatus 200 generates a composite image desired by the user. Can be displayed.

  In this example, in the image before designating the transmission region 271 (that is, before synthesis), only the vase is placed on the table as shown in FIG. On the other hand, when the user designates the transmissive area 271, depending on the position and shape of the transmissive area 271, an image after designation (that is, after synthesis) has an apple (or an image) on the table as shown in FIG. Cup) will appear. By changing the position and shape of the transmissive region 271, the user can freely change the part of the displayed image that is desired to be compared. Thus, the difference between the two images can be clearly recognized. It will be hard to imagine that the more complex the images you want to compare, the more this effect will be achieved.

  The present invention can be used in various situations. For example, the present invention can be applied to a game such as “find mistakes” that finds a difference between two pictures. Conventionally, two pictures are displayed side by side and displayed on the screen to search for differences, but in this method, it is necessary to secure a wide image area in order to display two pictures simultaneously. However, according to the present embodiment, since two pictures are displayed so as to overlap each other, it is not necessary to secure an extra image area, and the configuration of the screen layout can be simplified. Moreover, since only the picture of the part that the user wants to pay attention is exchanged as if it is highlighted, it becomes easier to find the difference.

  For example, one of the two images can be applied to a method for viewing the difference between the present and the past by setting one of the images to a current landscape at a certain location and the other as a past landscape at the same location. In addition to pictures, the images can also be digital images of photos of streets and scenery, aerial photos, and the like.

  For example, it can be used in an inference game that solves the mystery of the current incident. The first image data 251 is an on-site photo image indicating the current situation. When the player designates an arbitrary location (transmission area 271) of the site photograph, the image processing apparatus 200 produces a past image (second image) in the vicinity of the site while directing only that portion as if "digging a hole in the space-time". The image data 252) is partially combined and displayed. Instead of simply comparing the two pictures to find the difference, the player must search for the difference while considering where to focus and where to focus, and the reasoning ability is tested. In this way, it is possible to create a game that makes the player think more and a game that uses the head.

  In the present embodiment, two image data are synthesized, but it goes without saying that the number is not limited to two and may be three or more. That is, in this case, the image storage unit 201 further stores the third image data, the fourth image data, the Nth image data (N is an integer of 2 or more), in addition to the first image data 251 and the second image data 252. To do. The transparent area input receiving unit 203 receives an input designating two or more transparent areas 271. The synthesizing unit 205 may synthesize these N pieces of image data to generate the display image 280.

  Thus, according to the present embodiment, the image processing apparatus 200 can make the difference between the plurality of images reasonably understandable to the user, and can clearly express the difference.

(Embodiment 2)
Next, other embodiments of the present invention will be described. In the present embodiment, for example, by changing the enlargement / reduction ratio between the first image data 251 and the second image data 252, it becomes easier for the user to find the difference between these images, and the image processing apparatus 200 clearly expresses the difference between the images. It is something that can be done.

  The image storage unit 201 stores a plurality of image data having different enlargement / reduction ratios. For example, FIG. 8A shows the first image data 251, and FIG. 8B shows the second image data 252. The entire vertical length Lv and horizontal length Lh of the second image data 251 are the same as those of the first image data 251, but the scene shown in the second image data 252 is N times as large as the first image data 251. Has been reduced. The scene reflected in the second image data 252 is viewed from a wider angle than the first image data 251, and the second image data 252 in FIG. 8B is reflected in the first image data 251 in FIG. 8A. The surrounding scene that was not cut is also included. (In this example, outlets and wall holes are also shown.)

  FIG. 9 shows an example of a display image 280 synthesized by the synthesis unit 205 using the first image data 251 shown in FIG. 8A and the second image data 252 shown in FIG. As described above, since the first image data 251 and the second image data 252 have different enlargement / reduction ratios, the display image 280 is a perspective image. That is, it seems to the user that the second image data 252 is farther than the first image data 251. In this way, it becomes easy to distinguish images by using image data with different scaling ratios.

  Although the case where 0 <N <1 (ie, reduction) has been described here, N> 1 (ie, enlargement) may be used. If N = 1, the configuration is the same as that of the first embodiment.

  According to the present embodiment, the image is discontinuous due to the difference in the enlargement / reduction ratio at the boundary between the region that the user is paying attention to (the transparent region 271) and the region that is not, so that the two images can be easily distinguished. become. That is, since the image processing apparatus 200 can clearly display where the first image data 251 and where the second image data 252 is, the user can easily see the difference between the two images without losing sight of the two images. .

(Embodiment 3)
Next, other embodiments of the present invention will be described. In the above embodiment, image data that has been reduced or enlarged in advance is stored in advance in the image storage unit 201. However, in this embodiment, the first image data 251 and the second image data 252 have different enlargement / reduction ratios. As described above, the image processing apparatus 200 adjusts the image data each time. This will be described in detail below.

  FIG. 10 is a diagram illustrating a functional configuration of the image processing apparatus 200 according to the present embodiment. The image processing apparatus 200 further includes an adjustment unit 207. Note that a description of the same parts as those shown in the above embodiment is omitted.

  The image storage unit 201 stores the first image data 251 and the second image data 252 as in the first embodiment, and further stores the third image data 253.

In the present embodiment, the first image data 251 is data that is stored in advance by the processing control unit 10 in the VRAM 10c and stored in the ROM 12a.
The second image data 252 is data generated based on the third image data 253 by the processing control unit 10 to be described later, and is stored in the VRAM 10c. This corresponds to the second image data 252 previously scaled in the second embodiment described above, but is generated by the processing control unit 10 in the present embodiment.
The third image data 253 is data that is stored in advance in the ROM 12a by the processing control unit 10 and is read and stored in the VRAM 10c. The third image data 253 corresponds to the second image data 252 that is not scaled in the first embodiment. . In other words, the third image data 253 becomes an original picture for generating the second image data 252.

  The adjustment unit 207 performs image processing on the third image data 253 using a predetermined image processing filter, and stores the generated data in the image storage unit 201 as the second image data 252. For example, the adjustment unit 207 applies a filter that adjusts the size by reducing or enlarging the third image data 253 at a predetermined enlargement / reduction ratio, and stores the image-processed data in the image storage unit 201 as the second image data 252. . The process control unit 10 functions as the adjustment unit 207.

  Here, the image processing performed by the adjustment unit 207 will be described in more detail. FIG. 11A shows the third image data 253 that is an original picture, and the vertical length is Lv and the horizontal length is Lh. The shaded portion is the entire third image data 253 image. In the following description, the adjustment unit 207 adjusts an image by enlarging or reducing the enlargement / reduction ratio by N times (N is a predetermined positive value).

(A) When reducing:
As shown in FIG. 11B, the adjustment unit 207 reduces the third image data 253 by N times vertically and N times horizontally.

  The adjustment unit 207 expands the entire size of the image data obtained by the reduction to the same size as the second image data 252. A rectangular area indicated by a dotted line in this figure is image data after expansion, and the vertical length is Lv and the horizontal length is Lh.

  At the time of expansion, the adjustment unit 207 assigns a predetermined color (white, black, etc.) or a predetermined pattern pattern to the expanded portion for filling (filling).

  Then, the adjustment unit 207 stores the obtained image data as second image data 252 in the image storage unit 201. An example of the second image data 252 obtained in this way is shown in FIG. The shaded portion in this figure is the expanded (compensated) portion.

  Here, various methods are conceivable as to what kind of image is assigned to the extended portion at the time of expansion. As an example, there is a method of spreading the peripheral portion of the image as shown in FIG. The adjustment unit 207 arranges the image data 1301 so that the center of the image data 1301 obtained by reducing the third image data 253 coincides with the center 1302 of the second image data 252.

  Next, the adjustment unit 207 acquires the pixel value assigned to the upper end line 1303 of the image data 1301, and repeatedly assigns the acquired pixel value until the size of the second image data 252 is reached in the arrow YA direction. In other words, the upper part of the image data 1301 is expanded as if the metal plate was hit and extended. Similarly, the lower end line is extended in the arrow YB direction, the left end line is extended in the arrow YC direction, and the right end line is extended in the arrow YD direction.

  In the arrow YE direction, the average value of the pixel value of the upper end line and the pixel value of the left end line is calculated, assigned, and spread. Similarly, the average value of the upper end line and the right end line is calculated in the arrow YF direction, the average value of the lower end line and the right end line is calculated in the arrow YG direction, and the average value of the lower end line and the left end line is calculated in the arrow YH direction, respectively. And assign and spread. Note that the pixel values at the time of extending in the oblique direction do not necessarily have to be average values, and may be values calculated based on the pixel values of the upper end, lower end, left end, and right end lines.

  In this way, arbitrary image data can be reduced and adjusted to have the same size. The image data portion used for spreading may be one line each at the upper end, lower end, right end, and left end, or a plurality of lines may be combined into one pattern and expanded by repeating this pattern. Also good. Further, a value obtained by performing a predetermined calculation such as an average of pixel values of a plurality of lines may be used.

(B) When enlarging:
As shown in FIG. 11C, the adjustment unit 207 enlarges the third image data 253 by N times vertically and N times horizontally.

  The adjustment unit 207 removes (cuts) the entire size of the enlarged image data so as to be the same size as the second image data 252. A rectangular area indicated by a dotted line in this figure is an image data area after cutting, and the vertical length is Lv and the horizontal length is Lh.

  Then, the obtained image data is stored in the image storage unit 201 as the second image data 252. An example of the second image data 252 obtained in this way is shown in FIG. The hatched portion in this figure is a cut portion.

  The synthesizing unit 205 stores the second image data 252 generated by reducing as described in (A) or expanding as shown in (B) in the image storage unit 201, and generating the generated second image data 252. The same image generation processing as described above is performed using the two-image data 252.

  As described above, according to the present embodiment, the image processing apparatus 200 can generate an arbitrarily reduced or enlarged image and synthesize a display image. That is, it is not necessary to prepare a reduced or enlarged image in advance. Then, the difference between the images can be expressed more clearly by reducing or enlarging the images so that the enlargement / reduction ratios of the images are different.

(Embodiment 4)
Next, other embodiments of the present invention will be described. In the above-described embodiment, the enlargement / reduction ratio is a predetermined value, but in this embodiment, it is variable depending on the size of the transmissive region 271 specified by the user. This will be described in detail below.

  The adjustment unit 207 calculates a parameter for determining the size of the transmissive region 271 based on the transmissive region information 275 stored in the region storage unit 204. Typically, this parameter is the area of the transmissive region 271. Then, the third image data 253 is reduced or enlarged using an enlargement / reduction ratio previously associated with the size of the parameter.

  FIG. 14A is a diagram illustrating an example of the relationship between the area value and the enlargement / reduction ratio when the area of the transmission region 271 is adopted as a parameter. In this example, the enlargement / reduction ratio is constant (Nmax) when the area value S ≦ S1, is monotonically decreased when S1 <S <S2, is minimal (Nmin) when S2, is monotonically increased when S2 <S <S3, and is constant when S3 ≦ S ( Nmax). It may be used when the second image data 252 is generated by reducing the third image data 253.

  That is, if the enlargement / reduction ratio is too small when the transmissive area 271 is small, the image in the transmissive area 271 (that is, part of the second image data 252) may be too small to be seen. Below S1, the enlargement / reduction ratio is not changed. On the other hand, the transmissive area 271 can be enlarged to the same size as the display area 261. However, if the enlargement / reduction ratio is small when the transmissive area 271 becomes the same size as the display area 261, an image generated by spreading is generated. Since the area becomes relatively wide and the original image (scenery reflected in the third image data 253) may be reduced, the enlargement / reduction ratio is not changed beyond a certain area value S3. In a broad sense, it can also be said that S <S2 is monotonically decreasing, S2 is minimal, and S2 <S is monotonically increasing. Here, the change in transmittance is expressed linearly, but may be monotonously increased or decreased monotonously using an arbitrary function.

  FIG. 14B is a diagram illustrating another example of the relationship between the area value and the enlargement / reduction ratio. In this example, the enlargement / reduction ratio is constant when the area value S ≦ S4 (Nmin), monotonically increases when S4 <S <S5, maximum (Nmax) when S5, monotonically decreases when S5 <S <S6, and constant when S6 ≦ S ( Nmin). It may be used when generating the second image data 252 by enlarging the third image data 253.

  That is, if the enlargement / reduction ratio becomes too large when the transmission area 271 is small, the image in the transmission area 271 (that is, a part of the second image data 252) is too large to be understood or it is difficult to grasp where the entire image has been enlarged. Therefore, the enlargement / reduction ratio is not changed below a certain area value S4. On the other hand, if the enlargement / reduction ratio is large when the size of the transmissive area 271 is the same as that of the display area 261, an image obtained by enlarging only a part of the third image data 253 occupies most of the screen. Since there is a possibility that the whole cannot be compared with each other, the enlargement / reduction ratio is not changed at a certain area value S6 or more. In a broad sense, it can be said that S <S5 is monotonically increasing, S5 is maximal, and S5 <S is monotonically decreasing. Here, the change in transmittance is expressed linearly, but may be monotonously increased or decreased monotonously using an arbitrary function.

  As described above, according to the present embodiment, by using in combination with the above-described embodiment, the difference can be expressed more clearly while considering the visibility of the image for the user. Since the image in the transparent area 271 designated by the user is displayed by being appropriately reduced or enlarged, the image is not too small or too large to be difficult to understand. The relationship between the area value and the enlargement / reduction ratio shown in this embodiment is merely an example, and may be associated by other mathematical expressions / methods. Moreover, you may link | relate by the data table which matched not the numerical formula but the area value and the expansion / contraction rate. In this case, it is desirable to interpolate between samples by a spline interpolation method or the like.

(Embodiment 5)
Next, other embodiments of the present invention will be described. In each of the above-described embodiments, the display image 280 is displayed in a stationary manner. However, in this embodiment, when the user moves the display area 261 up, down, left, and right (scrolls), the transmission area 271 and the others are accordingly accompanied. By changing the display method of these areas, the difference in image is expressed more clearly. This embodiment can be used in combination with any of the above-described embodiments. However, in order to facilitate understanding, in the following description, an embodiment in which image data is not reduced or enlarged (that is, equivalent to Embodiment 1) is described. Combination).

  FIG. 15 is a diagram illustrating a functional configuration of the image processing apparatus 200 according to the present embodiment. The image processing apparatus 200 further includes a movement input reception unit 208 and an update unit 209. Note that a description of the same parts as those shown in the above embodiment is omitted.

  The movement input receiving unit 208 receives an instruction input for designating a direction and an amount for moving the position of the display area 261 in the first image data 251 from the user. The user can scroll the image displayed in the display area 261 by pressing the operation key 17 or pressing the touch panel 20 using a touch pen, for example. The processing control unit 10, the control key 17, and the touch panel 20 operate in cooperation to function as the movement input reception unit 208.

  The update unit 209 moves the positions of the display areas 261 and 262 and the transmission areas 271 and 272 stored in the area storage unit 204 by the direction and the amount indicated by the instruction input received by the movement input reception unit 208 to display the display area. Information 265 and transparent area information 275 are updated. The process control unit 10 functions as the update unit 209.

  FIG. 16A is a diagram showing the positional relationship between the display area 261 and the transmission area 271 in the first image data 251 before movement. FIG. 16B is a diagram showing the positional relationship between the display area 262 and the transmission area 272 in the second image data 252 before movement. Before the movement, the relative position of the display area 261 with respect to the first image data 251 and the relative position of the display area 262 with respect to the second image data 252 are the same. Similarly, the relative position of the transmissive region 271 with respect to the first image data 251 and the relative position of the transmissive region 272 with respect to the second image data 252 are the same. The relative position of the center of the transmission region 271 with respect to the first image data 251 (the center of the circle if the shape is circular) 1601 and the center of the transmission region 272 with respect to the second image data 252 (the center of the circle if the shape is circular) The relative position of 1602 is the same.

  For example, it is assumed that the movement input receiving unit 208 receives an instruction input for moving the position of the display area 261 by a distance L1 in the right direction in the figure. At this time, as shown in FIG. 16C, the update unit 209 moves the display area 261 in the first image data 251 to the right by the distance L1, and similarly moves the transmission area 271 to the right by the distance L1. Let On the other hand, as shown in FIG. 16D, the update unit 209 moves the display area 262 in the second image data 252 to the right by the distance L1, and moves the transmissive area 272 to the right by the distance L2. In this example, L2 <L1.

The relationship between the distances L1 and L2 is expressed by the following [Equation 1], for example.
L2 = L1 × C (Equation 1)
However, C is a positive constant. L1 and L2 are in a proportional relationship.

  After the update unit 209 updates the positions of the display areas 261 and 262 and the transmission areas 271 and 272, the synthesis unit 205 performs the same image generation process as that in the above-described embodiment. The display unit 206 displays the display image 280 generated by the synthesis unit 205.

  That is, in the display image 280, the image in the display area 261 scrolls to the right by the distance L1, whereas the image in the transmission area 271 scrolls to the right by the distance L2 shorter than L1. The resulting image is As a result, the display image 280 becomes an image having a sense of perspective and a stereoscopic effect.

  Here, L2 <L1 is set, but this is suitable for the case where an image smaller than the first image data 251 is used as the second image data 252. For example, when the scaling ratio is N, it is desirable to calculate L2 in accordance with the following mathematical expression.

  L2 = L1 × N (Equation 2)

  If [Equation 2] is used, and the adjustment unit 207 changes the expansion / contraction ratio N according to the area of the transmission region 271 as in the above-described embodiment, not only the amount of positional deviation, The amount of size deviation also changes, resulting in a more perspective and stereoscopic image.

  Conversely, L1 <L2 may be set, but this is suitable when an image enlarged from the first image data 251 is used as the second image data 252. If L2 = L1, the configuration is the same as that of the first embodiment.

  Further, the case of scrolling in the right direction has been described as an example, but the same applies to the case of scrolling in the up / down / left / right or diagonal directions.

(Embodiment 6)
Next, other embodiments of the present invention will be described. In the above-described embodiment, the adjustment unit 207 performs image processing for enlarging or reducing the image data. However, the present embodiment is different in that the image data is adjusted by performing other image processing. For example, the adjustment unit 207 performs color correction on the third image data 253 by performing a color filter to generate the second image data 252. This will be described in detail below.

  The adjustment unit 207 reads the third image data 253 stored in the image storage unit 201 and applies a predetermined image filter to the entire area or a partial area of the third image data 253 to generate the second image data 252. The synthesizing unit 205 generates a display image 280 using the second image data 252 image-processed by this image filter. There are various types of image filters. For example, there are a color conversion filter, a color separation filter, an edge filter, a resolution filter, and the like. The above-described enlargement / reduction process is also an image process using a kind of filter (enlargement / reduction filter) for enlargement / reduction of an image.

  The color conversion filter converts a specific color component of the third image data 253 to change the color tone (tone). For example, when the adjusting unit 207 generates the second image data 252 by converting the third image data 253 to sepia or black and white, and the combining unit 205 combines the second image data 252 and the first image data 251, the display image 280 is displayed. Among them, the inside of the transmissive area 271 looks like a “photo taken in the past”, and the distinction between the first image data 251 and the second image data 252 is clear. The adjustment unit 207 stores in advance information indicating a correspondence relationship that defines which color is converted to which color, and performs color conversion on the third image data 253 based on the information. The correspondence can be changed freely.

  The color separation filter extracts only one of R (red), G (green), and B (blue) color components (specific wavelength region) from the third image data 253. Alternatively, only a specific lightness / saturation / hue component is extracted. For example, when the adjustment unit 207 applies an R filter to the third image data 253 and the combining unit 205 combines the second image data 252 and the first image data 251, the transmissive area 271 in the display image 280 is red. An image is obtained by extracting only the components. For example, when a filter that increases (or decreases) the brightness is applied to the third image data 253, the display image 280 becomes an image in which the inside of the transmissive area 271 becomes bright (or dark).

  The edge filter enhances the sharpness by enhancing the contour (edge) portion of the image of the third image data 253, or conversely blurs the contour portion to reduce the sharpness. When the adjustment unit 207 increases the sharpness of a certain contour portion (for example, the contour portion of a character) in the image of the third image data 253, and the combining unit 205 combines the second image data 252 and the first image data 251, In the display image 280, the inside of the transmissive area 271 is a sharply tightened image with emphasized edges. On the other hand, if the sharpness is lowered, the image in the transmissive area 271 of the display image 280 becomes blurred and blurred. Note that the edge enhancement processing can be performed using a generally known method such as an unsharp masking method.

  The resolution filter increases the resolution of the third image data 253 so that a finer portion can be seen, or decreases the resolution. When the adjustment unit 207 applies a filter for increasing the resolution to the third image data 253 and the combining unit 205 combines the second image data 252 and the first image data 251, the transmissive area 271 in the display image 280 is detailed. The image becomes clear and easy to see. When a filter that lowers the resolution is applied, an image that looks like a mosaic appears only in the transmissive region 271.

  For example, a predetermined number of resolution levels (for example, three levels of high, medium, and low) are provided in advance. In normal times (when the transmissive area 271 is not designated), the synthesis unit 205 displays the first image data 251 having a predetermined non-maximum resolution (for example, the middle level among the three levels of high, medium, and low) as the display image 280. To do. At the time of designation (when the transmissive area 271 is designated), the composition unit 205 sets the first image data 251 having a predetermined resolution and a resolution higher than the default resolution (for example, high level among high, medium, and low). A display image 280 is generated using the second image data 252.

  When using a filter that lowers the resolution, at the time of designation, the combining unit 205 generates first image data 251 having a predetermined resolution and second image data 252 having a resolution lower than the default resolution (for example, low level among high, medium, and low). To generate a display image 280. The size of the resolution is not limited to three levels, and may be any M level (M is an integer of 2 or more), and the resolution selection method is also free. Note that the process of reducing the resolution can be performed using a generally known mosaic process.

  Image processing using these image filters may be performed not only on the third image data 253 but also on the first image data 251 and the second image data 252. That is, the adjustment unit 207 applies a color conversion filter, a color separation filter, an edge filter, a resolution filter, and an enlargement / reduction filter to at least one of the first image data 251, the second image data 252, and the third image data 253. The display image 280 may be generated using the first image data 251 and / or the second image data 252 and / or the third image data 253 subjected to the image processing.

  For example, when the transmissive area 271 is designated by the user, the adjustment unit 207 lowers the brightness of the part other than the transmissive area 271 in the display area 261 of the first image data 251 (makes it darker), and then adjusts the second image data. Of the display area 262 of 252, the brightness of the transmissive area 272 may be increased (brightened), and these image data may be combined to generate the display image 280. As a result, the display image 280 becomes an image that is brightened by hitting a spotlight (transmission area 271) that the user is paying attention to, and the first image data 251 and the second image data 252 can be easily distinguished. Become.

  Note that the adjustment unit 207 may adjust image data using at least one of these image filters. You may adjust an image by combining two or more said image filters arbitrarily. Moreover, you may adjust an image using the filter for image processing other than the filter illustrated here.

  According to the present embodiment, in the image displayed by the image processing apparatus, a discontinuous portion is generated between the place where the user is paying attention and the place where the user is not, and the difference between these places is clearly shown by the image filter. Therefore, the user can easily find the difference without losing sight of the boundary between the images being compared.

(Embodiment 7)
Next, other embodiments of the present invention will be described. In the present embodiment, the user can freely edit the display image 280 synthesized by the above-described image generation processing. This embodiment can be used in combination with any of the above-described embodiments. However, in order to facilitate understanding, in the following description, an embodiment in which image data is not reduced or enlarged (that is, equivalent to Embodiment 1) is described. Combination).

  FIG. 17 is a diagram illustrating a functional configuration of the image processing apparatus 200 according to the present embodiment. The image processing apparatus 200 further includes a selection input receiving unit 210 and a moving unit 211. Note that a description of the same parts as those shown in the above embodiment is omitted.

  The selection input receiving unit 210 selects item image data in the display image 280 and receives an instruction input for moving the position of the selected item image data from the user. The user can select and move any item image data arranged in the display image 280 by pressing the operation key 17 or pressing the touch panel 20 using a touch pen, for example. For example, the item image data is an image of an object such as a flower, a vase, a table, an apple, or a cup if the first image data 251 and the second image data 252 are shown in FIGS. It is data. The object to be moved (movable object) is arbitrary. The processing control unit 10, the operation key 17, and the touch panel 20 operate in cooperation to function as the movement input reception unit 210.

  The area storage unit 204 further includes information (hereinafter referred to as “item area information”) 285 that associates the position of the item image data corresponding to the movable object and the image area (item area) occupied by the item image data. Remember. When a plurality of item image data are arranged in the first image data 251 and the second image data 252, item area information 285 for storing the position and the area for each is stored.

  The moving unit 211 determines whether or not the entire item region in which the item image data selected by the user is displayed is included in the transparent region 271. If the moving unit 211 determines that the entire item region is included, the selection input receiving unit 210 The item image data is moved to the position indicated by the received instruction input. In other words, the moving unit 211 causes the region storage unit 204 to store the item region information 285 in which the position of the item image data is updated according to the determination result and the instruction input from the user. The processing control unit 10 functions as the moving unit 211.

  Processing for moving the item image data and editing the display image 280 will be described with reference to display examples shown in FIGS. 18A to 18D and a flowchart of FIG.

  FIG. 18A shows a display image 280 before moving (before editing). The user can set the transmissive area 271 at an arbitrary location. In addition, the position of the display area 261 can be changed. The transparent area input receiving unit 203 updates the transparent area information 275 according to the user's instruction input, and the display area input receiving unit 202 updates the display area information 265 according to the user's instruction input.

  FIG. 18B shows a display image 280 after the transparent region 271 is set by the user and synthesized by the above-described image generation processing. In this case, the transparent area 271 includes an apple object 1801 and a vase object 1802 as movable objects. The apple object 1801 is entirely contained in the transmission area 271, but the vase object 1802 includes only a part thereof and does not fit all. The combining unit 205 generates a display image 280 from the first image data 251 and the second image data 252 based on the display region information 265 and the transmission region information 275, and the display unit 206 displays the generated display image 280. To do.

  The user can change the position of the item image data by moving a predetermined pointer image 1803 (such as a mouse pointer). FIG. 18C is a diagram illustrating a state in which the user moves the position of an apple object 1801 that is one of item image data.

  First, the moving unit 211 determines whether or not the entire item area corresponding to the selected object is included in the transparent area 271 (step S1901).

  When it is determined that the whole is not included (step S1901; NO), the moving unit 211 does not permit the movement of the object. For example, since the vase object 1802 in FIG. 18B is not entirely contained in the transmission area 271, even if the vase object 1802 is selected by the user, the vase object 1802 is not moved.

  If it is determined that the whole is included (step S1901; YES), the moving unit 211 permits the movement of the object and changes the position of the object (step S1902). That is, the moving unit 211 moves the item image data to the position indicated by the instruction input received by the selection input receiving unit 210, and updates the item region information 285. For example, since the apple object 1801 in FIG. 18B is entirely contained in the transparent area 271, if the user gives an instruction to move the apple object 1801, the position is changed according to the instruction.

  Then, the composition unit 205 generates a display image 280 from the first image data 251 and the second image data 252 based on the display area information 265, the transparent area information 275, and the item area information 285 (step S1903).

  FIG. 18D is an example of the display image 280 (after editing) generated by the combining unit 205. Although the apple object 1801 is not displayed in the display image 280 before editing shown in FIG. 18A, the item image data (apple object 1801) displayed in the transparent area 271 is selected and moved (dragged). Thus, the apple object 1801 is displayed on the display image 280 after editing.

  In other words, a series of operations are performed in which two images are stacked, a hole is made in the upper image, a part of the lower image that has come out is taken out, and the hole is closed. That's right.

  For example, if the upper side (first image data 251) is an image that the user wants to edit and the lower side (second image data 252) is a sample image, the user wants to focus on a portion of interest (transparent region 271). The image can be freely edited by cutting out and pasting an arbitrary region (item region) of the sample image while comparing only. In other words, it is possible to create an image by placing a collection of image materials on the lower side and a canvas on the upper side, and it is not necessary to secure an extra work space.

  Note that the position of the item image data can be changed when the entire item area is included in the transparent area 271, but one item is included in the transparent area 271 regardless of whether or not the entire item area is included. If it is included in the part, it may be movable.

  As described above, according to the present embodiment, the image processing apparatus 200 can clearly express the difference between the images, and the user can easily understand the difference between the images. Moreover, the user can easily edit the image. For example, this embodiment can be used as a tool for a user to create a new image with reference to a sample image. Further, if the present invention is used, the screen layout of the image editing software can be simplified, a wider editing area can be secured in the screen, and the operability for the user is improved.

  The present invention is not limited to the above-described embodiments, and various modifications and applications are possible. Moreover, it is also possible to freely combine the components of the above-described embodiments.

  A program for operating the image processing apparatus 200 as all or part of the apparatus is stored and distributed in a computer-readable recording medium such as a memory card, CD-ROM, DVD, or MO (Magneto Optical disk). May be installed in another computer and operated as the above-described means, or the above-described steps may be executed.

  Furthermore, the program may be stored in a disk device or the like included in a server device on the Internet, and may be downloaded onto a computer by being superimposed on a carrier wave, for example.

  As described above, according to the present invention, it is possible to provide an image processing apparatus, an image processing method, and a program suitable for making it easy for a user to distinguish a difference between a plurality of images.

It is a figure which shows schematic structure of the typical information processing apparatus with which the game device of this invention is implement | achieved. It is a figure for demonstrating the functional structure of an image processing apparatus. (A) It is an example of 1st image data. (B) It is an example of 2nd image data. (A) It is a figure which shows the display area and transmission area which were set in 1st image data. (B) It is a figure which shows the display area and transmission area which were set in 2nd image data. (A) It is a conceptual diagram for demonstrating the process which synthesize | combines 1st image data and 2nd image data. (B) It is an example of the synthesized display image. It is a flowchart for demonstrating an image generation process. (A) It is a figure which shows the display area and transparent region in the 1st image data before a synthesis | combination. (B) It is a figure which shows the display area and transparent region in the 2nd image data before a synthesis | combination. (C) It is a figure which shows the display image after a synthesis | combination. (A) It is an example of the 1st image data of Embodiment 2. (B) It is an example of the 2nd image data of Embodiment 2. FIG. 10 is a diagram illustrating a display area and a transmission area after synthesis according to the second embodiment. FIG. 10 is a diagram for describing a functional configuration of an image processing apparatus according to a third embodiment. (A) It is a figure which shows the 3rd image data before reducing or enlarging. (B) It is a figure which shows the 3rd image data after reduction. (C) It is a figure which shows the 3rd image data after expansion. (A) It is an example of the 2nd image data formed by reducing 3rd image data and extending the periphery. (B) It is an example of the 2nd image data which expanded the 3rd image data and removed the periphery. It is a figure for demonstrating the process which spreads an image. (A) (b) is a figure which shows the relationship between the area of a transmissive area | region, and an expansion / contraction rate. FIG. 10 is a diagram for describing a functional configuration of an image processing apparatus according to a fifth embodiment. (A) It is a figure which shows the display area and transmission area | region of the 1st image data before a movement. (B) It is a figure which shows the display area and transmission area | region of the 2nd image data before a movement. (C) It is a figure which shows the display area and transmission area | region of 1st image data after a movement. (D) It is a figure which shows the display area and transmission area | region of the 2nd image data after a movement. FIG. 10 is a diagram for describing a functional configuration of an image processing apparatus according to a seventh embodiment. (A) It is a figure which shows the display image before edit. (B) It is a figure which shows a display image when a transmissive area | region is set. (C) It is a figure which shows a mode that the item image is moved. (D) It is a figure which shows the display image after edit. It is a flowchart for demonstrating an edit process.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Portable game machine 10 Processing control part 11 Connector 12 Cartridge 13 Wireless communication part 14 Communication controller 15 Sound amplifier 16 Speaker 17 Operation key 18 1st display part 19 2nd display part 20 Touch panel 200 Image processing apparatus 201 Image storage part 202 Display area input reception unit 203 Transparent area input reception unit 204 Area storage unit 205 Composition unit 206 Display unit 207 Adjustment unit 208 Movement input reception unit 209 Update unit 210 Selection input reception unit 211 Movement unit 251 First image data 252 Second image Data 253 Third image data 261, 262 Display area 265 Display area information 271, 272 Transparent area 275 Transparent area information 280 Display image 285 Item area information

Claims (13)

An image storage unit that stores first image data and second image data that is different from the first image data and has the same size;
A transparent area input receiving unit that receives an input for designating a position of a transparent area included in a display area of a predetermined size in the first image data from the user;
A selection input receiving unit that selects item image data arranged in the second image data and receives an instruction input for moving the position of the selected item image data from a user;
A moving unit that moves the item image data to a position indicated by the instruction input received by the selection input receiving unit when the entire item region in which the selected item image data is displayed is included in the transparent region;
Based on the position of the display area and the position of the designated transmission area, a display area and a transmission area in the second image data are obtained, and included in the display area of the first image data, and The image data of the area not included in the transparent area and the image data of the area included in the display area and included in the transparent area of the second image data are extracted and combined. A composition unit for generating a display image;
A display unit for displaying the generated display image;
An image processing apparatus comprising: The image processing apparatus according to claim 1,
A display area input receiving unit that receives an input for designating a position of the display area from the user;
An image processing apparatus. The image processing apparatus according to claim 1, wherein:
An area storage unit for storing the position of the display area and the position of the transmission area in the first image data, and the position of the display area and the position of the transmission area in the second image data; Prepared,
The combining unit combines the image data extracted from the second image data with the position of the transmission region in the first image data based on each position stored in the region storage unit.
An image processing apparatus. The image processing apparatus according to any one of claims 1 to 3,
The transparent area input receiving unit further receives an input specifying the shape of the transparent area,
The synthesizing unit extracts a portion corresponding to the designated position in the designated shape from the second image data;
An image processing apparatus. The image processing apparatus according to any one of claims 1 to 4,
The image storage unit further stores third image data,
An adjustment unit that adjusts an image by applying an image filter to the third image data, and stores the adjusted data in the image storage unit as the second image data;
An image processing apparatus. The image processing apparatus according to claim 5,
The adjustment unit adjusts the size of the third image data using a filter that enlarges or reduces at a predetermined enlargement / reduction rate.
An image processing apparatus. The image processing apparatus according to claim 6,
In the case of reducing the third image data, the adjustment unit expands a peripheral portion of the reduced image data and adjusts the same size as the second image data.
An image processing apparatus. The image processing apparatus according to claim 6,
When enlarging the third image data, the adjustment unit removes a peripheral portion of the enlarged image data and adjusts the same size as the second image data.
An image processing apparatus. The image processing apparatus according to any one of claims 5 to 8,
The adjustment unit enlarges or reduces the third image data at an enlargement / reduction rate associated with the area of the transmission region in advance.
An image processing apparatus. The image processing apparatus according to claim 5,
The adjustment unit includes a filter for enlarging or reducing the image at a predetermined scaling ratio, a filter for performing a predetermined color conversion on the image, a filter for extracting a predetermined color from the image, a filter for adjusting the edge of the image, Adjusting the third image data using at least one of a filter that changes the resolution of the image,
An image processing apparatus. The image processing apparatus according to any one of claims 1 to 10,
A movement input receiving unit that receives from the user an input for designating a direction and an amount for moving the position of the display area in the first image data;
When the movement input reception unit receives the instruction input, the position of the display area and the transmission area stored in the area storage unit is moved and updated in the direction by the amount calculated based on the amount. An update unit to
An image processing apparatus further comprising: An image processing method executed by an image processing apparatus having an image storage unit, a transparent area input receiving unit, a selection input receiving unit, a moving unit, a combining unit, and a display unit,
The image storage unit stores first image data and second image data that is different from the first image data and has the same size,
A transparent area input receiving step in which the transparent area input receiving unit receives from the user an input for designating a position of the transparent area included in the display area of a predetermined size included in the first image data;
A selection input reception step in which the selection input reception unit selects item image data arranged in the second image data and receives an instruction input for moving the position of the selected item image data from a user;
When the entire item area where the selected item image data is displayed is included in the transparent area, the moving unit moves the item image data to the position indicated by the instruction input received by the selection input receiving unit. A moving step;
The combining unit obtains a display area and a transmission area in the second image data based on the position of the display area and the position of the designated transmission area, and includes the display area of the first image data. And the image data of the area not included in the transparent area and the image data of the area included in the display area and included in the transparent area from the second image data are extracted. Combining to generate a display image,
A display step in which the display unit displays the generated display image;
An image processing method comprising: Computer
An image storage unit that stores first image data and second image data that is different from the first image data and has the same size;
A transparent area input receiving unit that receives from the user an input that specifies the position of the transparent area included in the display area of a predetermined size included in the first image data;
A selection input receiving unit that selects item image data arranged in the second image data and receives an instruction input for moving the position of the selected item image data from a user;
A moving unit that moves the item image data to a position indicated by an instruction input received by the selection input receiving unit when the entire item region in which the selected item image data is displayed is included in the transparent region;
Based on the position of the display area and the position of the designated transmission area, a display area and a transmission area in the second image data are obtained, and included in the display area of the first image data, and The image data of the area not included in the transparent area and the image data of the area included in the display area and included in the transparent area of the second image data are extracted and combined. A synthesis unit for generating a display image;
A display unit for displaying the generated display image;
A program characterized by functioning as

Images