JP7102772B2 - Image processing equipment and programs - Google Patents

Description

The present invention relates to an image processing apparatus and a program.

For example, a technique for decorating an object using an image, such as printing an image on the surface of an object or covering an object with a film on which the image is printed, is known. The objects to be decorated are the surface of objects, the interior and exterior of buildings and vehicles, wrapping paper, packing materials, and the like. Images such as abstract patterns and concrete patterns are used for decoration. When the size of the image prepared for decoration is smaller than the size of the surface to be decorated, a method of decorating by arranging multiple duplicate images extracted from the prepared image without gaps has been devised. Was done. For example, in Patent Document 1, a plurality of duplicated images are arranged so as to overlap each other, and the joints of the plurality of duplicated images are combined by using a feathering method, a graph cut method, and an image quilting method. It is stated that.

Japanese Patent No. 4415699

An object of the present invention is to make a joint of images inconspicuous even if a compositing process is not performed when a plurality of the same images are arranged without gaps to generate an output image. And.

The image processing apparatus according to claim 1 obtains a second band-shaped region whose image is similar to that of the first band-shaped region from the input image among the band-shaped regions in which the first band-shaped region included in the input image is moved in parallel . An image of a first region including an extraction unit to be extracted, a region sandwiched between the first band-shaped region and the second band-shaped region in the input image, and the first band-shaped region or the second band-shaped region. It is provided with a plurality of generation units for generating output images arranged without gaps.

The image processing device according to claim 2 includes a display unit for displaying the output image and a reception unit for receiving an operation in the image processing device according to claim 1, and the extraction unit has the first band shape. When the operation of changing the area is accepted by the reception unit, the second band-shaped area is extracted by using the changed first band-shaped area.

The image processing device according to claim 3 is the image processing device according to claim 2, wherein the reception unit sets the position of the end portion of the first band-shaped area in the extension direction of the first band-shaped area. Accept.

The image processing device according to claim 4 is the image processing device according to claim 2, wherein the reception unit receives an operation of setting an extension direction of the first band-shaped region.

The image processing device according to claim 5 is the image processing device according to claim 2, wherein the reception unit sets the width of the first band-shaped area in a direction intersecting the extension direction of the first band-shaped area. Accept operations.

The image processing apparatus according to claim 6 is the image processing apparatus according to claim 1, wherein the extraction unit extracts the second band-shaped region from the reduced input image.

The image processing apparatus according to claim 7 is the image processing apparatus according to claim 1, wherein the extraction unit obtains the first band-shaped region when the second band-shaped region is not extracted from the input image. The second band-shaped region is extracted by changing.

The image processing apparatus according to claim 8 controls the extraction unit and the generation unit so as to change the first band-shaped region to generate a plurality of output images in the image processing apparatus according to claim 2. The display unit displays a plurality of the output images, and the reception unit receives an operation of selecting one of the plurality of output images.

The image processing apparatus according to claim 9 is the image processing apparatus according to claim 1, wherein the extraction unit is a band-shaped region obtained by translating a third band-shaped region intersecting with the first band-shaped region . A fourth band-shaped region having an image similar to that of the third band-shaped region was extracted from the input image, and the generation unit was sandwiched between the third band-shaped region and the fourth band-shaped region of the first region. An output image is generated in which a plurality of images of the second region including the region and the third band-shaped region or the fourth band-shaped region are arranged without gaps.

The program according to claim 10 uses the input image to obtain a second band-shaped region whose image is similar to that of the first band-shaped region among the band-shaped regions obtained by moving the computer in parallel with the first band-shaped region included in the input image. An image of a first region including an extraction unit to be extracted, a region sandwiched between the first band-shaped region and the second band-shaped region in the input image, and the first band-shaped region or the second band-shaped region. This is a program for functioning as a generator that generates multiple output images arranged without gaps.

According to the inventions according to claims 1 and 10, when a plurality of the same images are arranged without gaps to generate an output image, the joints are inconspicuous even if the joints of the plurality of images are not combined. The output image is generated.
According to the second aspect of the present invention, after the user confirms the output image, the output image is regenerated using the first band-shaped region modified by the user.
According to the third aspect of the present invention, the output image is regenerated using the first band-shaped region in which the user has changed the position of the end portion.
According to the invention of claim 4, the output image is regenerated using the first band-shaped region in which the user has changed the extension direction.
According to the invention of claim 5, the output image is regenerated using the first band-shaped region whose width has been changed by the user.
According to the invention of claim 6, the extraction of the second band-shaped region is speeded up as compared with the case of using the input image which is not reduced.
According to the invention of claim 7, when the second band-shaped area is not extracted, the first band-shaped area is changed and the second band-shaped area is extracted again without any operation by the user.
According to the invention of claim 8, the user is given a choice of output images.
According to the invention of claim 9, an output image in which the joint extending in the direction intersecting with the first band-shaped region is inconspicuous is generated.

The figure which shows an example of the input image IMG_IN. The figure which shows the structure of the image processing apparatus 10. The flow chart which shows the whole process executed by the control unit 11. The figure which shows the 1st band-shaped region B1. The figure which shows the process of extracting the 2nd band-shaped region B2. The figure which shows the extracted 2nd band-shaped region B2. The figure which shows the 3rd band-shaped region B3. The figure which shows the process of extracting the 4th band-shaped region B4. The figure which shows the extracted 4th band-shaped region B4. The figure which shows the screen which includes the output image IMG_OUT. The figure which shows the example of the screen which contains a plurality of output images. The figure which shows the outline of the synthesis process. The figure which shows the pixel. The figure which shows the example which executed the synthesis processing by the propagation of a pixel value.

An example of a mode for carrying out the present invention will be described. In the present embodiment, a region satisfying a predetermined condition is extracted from an input image, a plurality of duplicate images of the image of the extracted region are generated, and an output image arranged without gaps is generated.

The input image in the present embodiment is an image in which at least spatial changes in color and shading are visually recognized. The input image is an image such as a concrete pattern or an abstract pattern. The concrete pattern is, for example, a picture depicting an artificial object or a natural object, a photograph of an artificial object or a natural object, or the like. Artificial objects include, for example, textiles, knitting, nets, brick walls, tiled walls, wallpaper, cobblestones and the like. Natural objects are, for example, cut surfaces of rocks, ground, plant tissues, crystals and the like. An abstract pattern is, for example, a geometric pattern, a character or symbol arranged regularly or irregularly.

FIG. 1 is a diagram showing an example of the input image IMG_IN. The input image IMG_IN is an image in which a pattern imitating a hexagonal shell is arranged in a rectangular area. Innumerable streaks representing the texture of the woven fabric are visible on the sides of the hexagon.

FIG. 2 is a diagram showing the configuration of the image processing device 10. The image processing device 10 includes a control unit 11, a storage unit 12, a communication unit 13, a display unit 14, and a reception unit 15. The control unit 11 includes an arithmetic unit such as a CPU (Central Processing Unit) and a storage device such as a ROM (Read Only Memory) and a RAM (Random Access Memory). The ROM stores the firmware that describes the procedure for booting the hardware and the OS (Operating System). The RAM is used to store data when the CPU executes an operation.

The storage unit 12 includes, for example, a memory or a hard disk storage device, and stores software such as an OS and an application. The communication unit 13 includes an I / F (Interface) for communicating with other electronic devices, and is connected to a LAN (Local Area Network), a memory card reader / writer, or the like.

The display unit 14 includes, for example, a display device such as a liquid crystal display panel. The control unit 11 causes the display unit 14 to display an operation screen for operating the image processing device 10. The reception unit 15 includes, for example, a keyboard, a pointing device, and the like, and receives operations on the operation screen. The pointing device is, for example, a touch panel, a mouse, a touch pad, or the like that covers the display surface of the display unit 14. The display unit 14 and the reception unit 15 may be configured as a device separated from the image processing device 10, and the display unit 14 and the reception unit 15 may be connected to the communication unit 13.

FIG. 3 is a flow chart showing the entire process executed by the control unit 11. A program describing the procedure of these processes is stored in the storage unit 12, and the control unit 11 executes the process according to this program. The control unit 11 functions as an extraction unit 111 and a generation unit 112 (see FIG. 2).

In step S01, the extraction unit 111 inputs a second band-shaped region B2 parallel to the first band-shaped region B1 included in the input image IMG_IN, and the second band-shaped region B2 whose image is similar to that of the first band-shaped region B1. Extract from image IMG_IN (extraction process). Specifically, it is as follows.

FIG. 4 is a diagram showing a first band-shaped region B1. The input image data representing the input image IMG_IN may be input to the image processing device 10 from another electronic device via a LAN, or may be input to the image processing device 10 via a memory card. The input image IMG_IN is represented by a set of regularly arranged pixels. The input image data includes a pixel value given to each of the pixels. The pixel value is represented by a value for each component in a color space such as RGB, CMYK, and CIELAB. The position of the pixel in the input image IMG_IN is represented by the coordinates (i, j) in the Cartesian coordinate system with the upper left of the input image IMG_IN as the origin (i = 0,1,2, ···, j = 0,1). , 2, ...). The direction from left to right on the x-axis is the positive direction, and the direction from top to bottom on the y-axis is the positive direction. In the present embodiment, it is assumed that pixels are arranged at equal intervals in the x-axis direction and the y-axis direction that are orthogonal to each other.

The first band-shaped region B1 is a band-shaped region as a whole including one row or a plurality of rows of pixels. The extension direction of the first band-shaped area B1, the positions of both ends of the first band-shaped area B1 in the extension direction of the first band-shaped area B1, and the width of the first band-shaped area B1 in the direction intersecting the extension direction of the first band-shaped area B1. Initial values are preset for each. The extension direction of the first band-shaped region B1 is represented by, for example, an angle with the counterclockwise direction as a positive with respect to the x-axis. The positions of both ends of the first band-shaped region B1 are represented by, for example, the coordinates of the pixels located at both ends of the first band-shaped region B1. The width of the first band-shaped region B1 is represented by, for example, the number of pixels in a direction intersecting the extension direction of the first band-shaped region B1. In the example of FIG. 4, the extension direction of the first band-shaped area B1 is set to the x-axis direction, the left end of the first band-shaped area B1 is set to a position inside the left end of the input image IMG_IN, and the first band-shaped area B1 is set. This is an example in which the right end is set at the same position as the right end of the input image IMG_IN.

FIG. 5 is a diagram showing a process of extracting the second band-shaped region B2. The extraction unit 111 performs a process of calculating the similarity between the image of the band-shaped region BY in which the first band-shaped region B1 is translated by Y pixels in the first direction and the image of the first band-shaped region B1 by setting Y to 1. It is repeated while increasing by 1, 2, 3, ..., And Y (hereinafter referred to as Yp) whose similarity satisfies a predetermined condition is specified. The first direction is a direction perpendicular to the extension direction of the first band-shaped region B1 (in this example, the positive direction of the y-axis). The extraction unit 111 extracts the band-shaped region BYp in which the first band-shaped region B1 is translated in the first direction by Yp pixels as the second band-shaped region B2.

The method for calculating the similarity according to the present invention is not limited to a specific method, but in the present embodiment, a cost function (objective function) is used as an example. The cost function is expressed by, for example, the equation (1). In this example, the cost function is a function in which the distance (number of pixels) Y in the y-axis direction between the first band-shaped area B1 and the band-shaped area BY, which is a candidate for the second band-shaped area B2, is set as an independent variable. The smaller this cost function, the higher the similarity. For example, the band-shaped region BYp when Y with the minimum cost function is Yp may be extracted as the second band-shaped region B2, and the band-shaped region BYp when the minimum Y with the cost function equal to or less than the threshold value is Yp. May be extracted as the second band-shaped region B2.

The cost function f (Y) shown in the above equation (1) is a pair of pixels corresponding to each other in the first band-shaped area B1 and the band-shaped area BY in which the first band-shaped area B1 is moved by Y in the y-axis direction. It is the sum of the absolute values of the differences between the pixel values of. Therefore, when the band-shaped region BYp when Y that minimizes the cost function is Yp is extracted as the second band-shaped region B2, Yp is expressed by the following equation (2).

FIG. 6 is a diagram showing the positional relationship between the first band-shaped region B1 and the extracted second band-shaped region B2. In FIG. 6, the distance between the first band-shaped region B1 and the second band-shaped region B2 in the y direction is the above-mentioned Yp. When the second band-shaped region B2 is extracted, the extraction unit 111 determines the region B12 sandwiched between the first band-shaped region B1 and the second band-shaped region B2 in the input image IMG_IN, and the first band-shaped region B1 or the second band-shaped region B1 or the second band-shaped region B2. The region B2 and the first region A1 including the region B2 are specified. There is a difference in the contents of the processing after step S02 depending on whether the first region A1 includes the region B12 and the first band-shaped region B1 or the first region A1 includes the region B12 and the second strip-shaped region B2. However, in the following, an example in which the first region A1 includes the region B12 and the second band-shaped region B2 will be illustrated.

Next, in step S02 (see FIG. 3), the extraction unit 111 is a fourth band-shaped region B4 parallel to the third band-shaped region B3 that intersects the first band-shaped region B1, and is an image with the third band-shaped region B3. Extracts a fourth band-shaped region B4 similar to the input image IMG_IN (extraction process).

FIG. 7 is a diagram showing a third band-shaped region B3. In the present embodiment, an example in which the third band-shaped region B3 is set so that the extension direction of the first band-shaped region B1 and the extension direction of the third band-shaped region B3 are orthogonal to each other is shown. In this example, the upper end of the third strip-shaped region B3 is set at the same position as the upper end of the first region A1, and the lower end of the third strip-shaped region B3 is set at the same position as the lower end of the first region A1.

FIG. 8 is a diagram showing a process of extracting the fourth band-shaped region B4. The extraction unit 111 calculates the similarity between the image of the band-shaped region B3p, which is equivalent to translating the third band-shaped region B3 in the second direction by one pixel, and the image of the third band-shaped region B3, and determines the similarity. Determines whether or not satisfies a predetermined condition. The second direction is a direction perpendicular to the extension direction of the third band-shaped region B3 (in this example, the positive direction of the x-axis). The extraction unit 111 translates the band-shaped region B3p in the second direction by one pixel until a band-shaped region B3p whose similarity with the third band-shaped region B3 satisfies a predetermined condition is found, and the third band-shaped region B3p is translated. It is determined whether or not the degree of similarity between the band-shaped region B3 and the band-shaped region B3p satisfies a predetermined condition. The extraction unit 111 extracts the band-shaped region B3p whose similarity satisfies a predetermined condition as the fourth band-shaped region B4.

FIG. 9 is a diagram showing the extracted fourth band-shaped region B4. When the fourth band-shaped region B4 is extracted, the extraction unit 111 uses the first region A1 to have a region B34 sandwiched between the third band-shaped region B3 and the fourth band-shaped region B4 and the third band-shaped region B3 or the third band-shaped region B4. The fourth band-shaped region B4 and the second region A2 including the fourth band-shaped region B4 are specified.

Next, in step S03 (see FIG. 3), the generation unit 112 generates an output image IMG_OUT in which a plurality of duplicate images A2r of the images in the second region A2 are arranged without gaps (generation processing). Next, in step S04, the display unit 14 displays the output image IMG_OUT (display processing).

FIG. 10 is a diagram showing a screen including the output image IMG_OUT. In this example, the input image IMG_IN is displayed side by side with the output image IMG_OUT for comparison with the output image IMG_OUT. In the input image IMG_IN, a frame indicating the second region A2 is displayed. The illustrated example is an example in which the second region A2 includes the region B34 and the third band-shaped region B3 (see FIG. 9). The output image IMG_OUT is an image in which a plurality of duplicate images A2r of the second region A2 are arranged without gaps. In this example, the boundaries of the plurality of duplicate images A2r are displayed, but the boundaries may not be displayed. A screen may be displayed for the user to select whether or not to display the boundary line.

Next, in step S05 (see FIG. 3), the reception unit 15 accepts the operation, and the control unit 11 determines the content of the operation (acceptance processing). If the "decision" button 151 shown in FIG. 10 is operated, the control unit 11 determines that the operation for determining the output image IMG_OUT has been accepted (step S05: determination of the output image), and proceeds to step S06. When the "change" button 152 is operated, the control unit 11 determines that the change of the first band-shaped area B1 has been instructed (step S05: change of the first band-shaped area), and proceeds to step S07.

Next, in step S06 (see FIG. 3), the generation unit 112 outputs the output image data representing the output image IMG_OUT to a file (output processing). Specifically, as shown in FIG. 10, the display unit 14 displays an input field 153 that accepts an operation for designating the number of duplicate images A2r in the x-axis direction and the y-axis direction (vertical and horizontal), and the reception unit 15 displays the input field 153. Accepts an input operation for specifying the number of duplicate images A2r in the x-axis direction and the y-axis direction, and the generation unit 112 arranges the specified number of duplicate images A2r in the x-axis direction and the y-axis direction without gaps. The image IMG_OUT is generated, and the output image data representing the output image IMG_OUT is output to a file. The output image data file is stored in the storage unit 12 in association with a predetermined folder or a folder designated by the user.

On the other hand, in step S07 (see FIG. 3), the control unit 11 changes the first band-shaped region B1. Specifically, the control unit 11 displays a screen (see FIG. 4) showing the current first band-shaped area B1 on the display unit 14, and the reception unit 15 accepts an operation of changing the first band-shaped area B1. The operation of changing the first band-shaped region B1 is performed, for example, by dragging and dropping using a pointing device. For example, the position and extension direction of the end portion are changed by the operation of moving the end portion of the first strip-shaped region B1 in the extension direction of the first belt-shaped region B1. For example, by translating the long side of the first band-shaped region B1 in the direction intersecting the extension direction of the first band-shaped region B1, the width of the first band-shaped region B1 in the direction intersecting the extension direction of the first band-shaped region B1. Is changed. When the process of step S07 is completed, the control unit 11 re-executes the processes after step S01. Then, a new output image IMG_OUT is generated using the changed first band-shaped region B1. The above is the content of the process executed by the control unit 11.

The object is decorated by printing the output image IMG_OUT on the surface of the object, covering the object with a film on which the output image IMG_OUT is printed, and the like. The objects to be decorated are the surface of objects, the interior and exterior of buildings and vehicles, wrapping paper, packing materials, and the like. Further, the output image IMG_OUT may be used for projection mapping.

According to the present embodiment, when a plurality of the same duplicate images A2r are arranged without gaps to generate the output image IMG_OUT, the joints are inconspicuous even if the joints of the plurality of duplicate images A2r are not combined. The output image IMG_OUT is generated. Further, according to the present embodiment, after the user confirms the output image IMG_OUT, the output image IMG_OUT is regenerated using the first band-shaped region B1 modified by the user. Further, according to the present embodiment, the output image IMG_OUT is regenerated using the first band-shaped region B1 in which the user has changed the position of the end portion. Further, according to the present embodiment, the output image IMG_OUT is regenerated using the first band-shaped region B1 in which the user has changed the extension direction. Further, according to the present embodiment, the output image IMG_OUT is regenerated using the first band-shaped region B1 whose width has been changed by the user. Further, according to the present embodiment, the output image IMG_OUT in which the joint extending in the direction intersecting with the first band-shaped region B1 is inconspicuous is generated.

The above embodiment may be modified as follows.

(1) The image processing device 10 may be configured so that the extraction unit 111 extracts the second band-shaped region B2 from the reduced input image IMG_IN. Specifically, the extraction unit 111 extracts the second band-shaped area B2 from the image in which the number of pixels is reduced by reducing the size of the input image IMG_IN, and the extracted second band-shaped area B2 is coordinate-converted. By doing so, the second band-shaped region B2 in the input image IMG_IN before reduction may be specified. According to this modification, the extraction of the second band-shaped region B2 is speeded up as compared with the case where the input image IMG_IN that is not reduced is used.

(2) The image processing device 10 causes the extraction unit 111 to change the first band-shaped area B1 and extract the second band-shaped area B2 when the second band-shaped area B2 is not extracted from the input image IMG_IN. It may be configured. The first band-shaped region B1 may be changed by, for example, the extraction unit 111 changing the position, width, extension direction, etc. of the end portion of the first band-shaped region B1 by a predetermined amount. 111 may be performed by randomly changing the position, width, extension direction, etc. of the end portion of the first band-shaped region B1. According to this modification, when the second band-shaped area B2 is not extracted, the first band-shaped area B1 is changed and the second band-shaped area B2 is extracted again without any operation by the user.

(3) A control unit 11 for controlling the extraction unit 111 and the generation unit 112 is provided so as to change the first band-shaped region B1 to generate a plurality of output images IMG_OUT, and the display unit 14 displays the plurality of output images IMG_OUT. Then, the image processing device 10 may be configured so that the reception unit 15 accepts an operation of selecting one of the plurality of output images IMG_OUT. The first band-shaped region B1 may be changed by, for example, the extraction unit 111 changing the position, width, extension direction, etc. of the end portion of the first band-shaped region B1 by a predetermined amount. 111 may be performed by randomly changing the position, width, extension direction, etc. of the end portion of the first band-shaped region B1.

FIG. 11 is a diagram showing an example of a screen including a plurality of output images IMG_OUT. “Pattern 1”, “Pattern 2”, and “Pattern 3” in the figure are output images IMG_OUT generated by changing the first band-shaped region B1. The "sample" is a display for allowing the user to select one of a plurality of input images IMG_IN different from each other. The "selected image" is an input image IMG_IN selected by the user from the "sample". When the "pattern generation" button is operated, the first band-shaped region B1 is changed to generate a plurality of output images IMG_OUT, and the plurality of output images IMG_OUT are displayed in the arrangement shown in FIG. When the "different pattern" button is operated, the first band-shaped region B1 is further changed to generate and display a plurality of output images IMG_OUT. According to this modification, the user is given the option of the output image IMG_OUT.

(4) In the above embodiment, the position of both ends of the first band-shaped region B1 in the extension direction of the first band-shaped region B1, the extension direction of the first band-shaped region B1, and the direction intersecting the extension direction of the first band-shaped region B1. An example in which initial values are preset for each of the widths of the band-shaped region B1 is shown, but these initial values may be set by the user.

(5) In the above embodiment, the present invention is applied to the arrangement of rectangular grids in which pixels are arranged at equal intervals in the x-axis direction and the y-axis direction orthogonal to each other. The present invention may be applied to the arrangement of rectangular grids in which the pixel spacing in the y-axis direction is different. Further, the present invention may be applied to an arrangement of an orthorhombic lattice, a hexagonal lattice, or the like in which pixels are arranged in the x-axis direction and the y-axis direction that are not orthogonal to each other.

(6) In the above embodiment, the first direction for translating the band-shaped region B1p in the process of extracting the second band-shaped region B2 is the direction perpendicular to the extension direction of the first band-shaped region B1. One direction does not have to be a direction perpendicular to the extension direction of the first band-shaped region B1.

(7) The process of step S02 in FIG. 3 may be omitted. This modification is, for example, a case where the width of the object to be decorated is narrower than the width of the input image IMG_IN in the x-axis direction or the y-axis direction, or a gradation or stripe in which the color of the input image IMG_IN changes only in the y-axis direction. It can be applied in some cases. That is, the present invention extracts a second band-shaped region B2 parallel to the first band-shaped region B1 included in the input image IMG_IN and a second band-shaped region B2 whose image is similar to that of the first band-shaped region B1 from the input image IMG_IN. A plurality of first regions A1 including an extraction unit 111, a region sandwiched between a first band-shaped region B1 and a second band-shaped region B2 in the input image IMG_IN, and a first band-shaped region B1 or a second band-shaped region B2. It can also be specified as an image processing device 10 including a generation unit 112 that generates an output image IMG_OUT in which the duplicate image A1r of the above is arranged without gaps.

(8) In the above-described embodiment, the output image in which the joints are inconspicuous is generated without performing the composite processing of the joints of the plurality of duplicated images in the extracted region, but the image in which the joints are inconspicuous is further produced. In order to generate the output image, the following compositing process may be performed after the output image is generated. FIG. 12 is a diagram showing an outline of the synthesis process. Here, for convenience of illustration, two duplicate images A2r are shown, but in reality, the following composition processing is performed on all the joints of the plurality of duplicate images A2r. FIG. 12A is a diagram showing how the two duplicate images A2r are arranged without a gap. In the compositing process, as shown in FIG. 12B, a rectangular unknown region Au including a joint between the two duplicate images A2r is set.

FIG. 13 is a diagram showing pixels. A plurality of rectangles arranged in a grid pattern shown in FIG. 13A represent pixels. Of these, the target pixel T is a pixel included in the unknown region Au. The adjacent pixel R is a pixel in the vicinity of 8 of the target pixel T. The adjacent pixel R may be a pixel in the vicinity of 4 or 16 of the target pixel T. The coupling coefficient between the target pixel T and the adjacent pixel R is calculated. The coupling coefficient is expressed using, for example, the Euclidean distance between the pixel value of the target pixel T and the pixel value of the adjacent pixel R. The shorter the Euclidean distance, the larger the coupling coefficient.

In FIG. 13B, the magnitude of the coupling coefficient is represented by the thickness of the line connecting the target pixel T and the adjacent pixel R. If the coupling coefficient with the adjacent pixel R is calculated for all the target pixels T included in the unknown region Au, the pixel values of the target pixels T are initialized (for example, all of RGB are set to 0). .. Pixel values are sequentially propagated from the boundary side of the unknown region Au toward the center of the unknown region Au. Propagation of the pixel value is performed by overwriting the target pixel T with a value obtained by multiplying the pixel value of the adjacent pixel R by the coupling coefficient. By this processing, the discontinuity of the joints of the plurality of duplicated images is alleviated, and the joints become less noticeable (FIG. 12 (c)).

FIG. 14 is a diagram showing an example in which a synthesis process is executed by propagating pixel values. The black pixel shown in FIG. 14A shows the unknown region Au, and FIG. 14B shows the result of propagating the pixel value. It can be seen that the pixel values are propagated from the pixels adjacent to the unknown region Au to the inside of the unknown region Au without any discomfort.

(9) The program for causing the computer to execute the above processing may be provided in a state of being continuously stored in a computer-readable recording medium such as an optical recording medium or a semiconductor memory, or may be provided on the Internet. It may be provided via a communication network such as. When the program according to the present invention is provided in a state of being continuously stored in a recording medium, a computer reads the program from the recording medium and uses it. When the program according to the present invention is provided via a communication network, the computer receives the program from the distribution source device and uses it.

10 ... Image processing device, 11 ... Control unit, 111 ... Extraction unit, 112 ... Generation unit, 12 ... Storage unit, 13 ... Communication unit, 14 ... Display unit, 15 ... Reception unit

Claims (10)

Among the band-shaped regions in which the first band-shaped region included in the input image is translated, a second band-shaped region whose image is similar to that of the first band-shaped region is extracted from the input image, and an extraction unit.
In the input image, a plurality of images of the first region including the region sandwiched between the first band-shaped region and the second band-shaped region and the first band-shaped region or the second band-shaped region are arranged without gaps. A generator that generates an output image and
An image processing device comprising. A display unit that displays the output image and
Equipped with a reception section that accepts operations
The first aspect of claim 1, wherein the extraction unit extracts the second band-shaped area by using the changed first band-shaped area when the operation of changing the first band-shaped area is accepted by the receiving unit. Image processing equipment. The image processing apparatus according to claim 2, wherein the reception unit receives an operation of setting the position of an end portion of the first band-shaped region in an extension direction of the first band-shaped region. The image processing device according to claim 2, wherein the reception unit receives an operation of setting an extension direction of the first band-shaped region. The image processing apparatus according to claim 2, wherein the receiving unit receives an operation of setting the width of the first band-shaped area in a direction intersecting the extension direction of the first band-shaped area. The image processing apparatus according to claim 1, wherein the extraction unit extracts the second band-shaped region from the reduced input image. The image processing apparatus according to claim 1, wherein the extraction unit modifies the first band-shaped region to extract the second band-shaped region when the second band-shaped region is not extracted from the input image. A control unit that controls the extraction unit and the generation unit so as to change the first band-shaped region to generate a plurality of output images is provided.
The display unit displays a plurality of the output images and displays the plurality of output images.
The image processing device according to claim 2, wherein the reception unit receives an operation of selecting one of the plurality of output images. The extraction unit extracts a fourth band-shaped region having an image similar to that of the third band-shaped region from the input image among the band-shaped regions obtained by translating the third band-shaped region intersecting with the first band-shaped region.
The generation unit is a second region of the first region, which includes a region sandwiched between the third band-shaped region and the fourth band-shaped region, and the third band-shaped region or the fourth band-shaped region. The image processing apparatus according to claim 1, wherein a plurality of images are arranged without gaps to generate an output image. Computer,
Among the band-shaped regions in which the first band-shaped region included in the input image is translated, a second band-shaped region whose image is similar to that of the first band-shaped region is extracted from the input image, and an extraction unit.
In the input image, a plurality of images of the first region including the region sandwiched between the first band-shaped region and the second band-shaped region and the first band-shaped region or the second band-shaped region are arranged without gaps. A program to function as a generator that generates an output image.

Images