JP6540389B2 - Image editing apparatus, image editing method and image editing program - Google Patents

Description

  The present invention relates to an image editing apparatus, an image editing method, and an image editing program, and more particularly, to an image editing apparatus that combines another image with an image of data, an image editing method and an image editing program executed by the image editing apparatus.

  2. Description of the Related Art In recent years, an image forming apparatus such as a multifunction peripheral (MFP) has a function of combining an image of data to be printed with a previously prepared additional image such as a stamp image for printing. For example, JP-A-2011-188197 is an image processing apparatus that combines a plurality of composite images with one image, and stores image data related to a plurality of composite images to be combined with the image. A storage unit that stores information of a prohibited area that is a partial area of the composite image and that prohibits overlapping with another composite image, together with image data related to the composite image; Determining means for determining whether or not another composite image overlaps the prohibited area of the composite image to be combined with the image based on the information of the prohibited area of the composite image being overlapped by the determination means Control means for giving a warning or controlling to move the other composite image to a position not overlapping the prohibited area. Location have been described.

On the other hand, in the MFP, a touch panel is often used as a user interface, and the user can drag and drop the additional image to determine the position where the additional image is to be arranged in the data image. However, in the image processing apparatus described in JP 2011-188197 A, after the user has determined the position of the additional image, it is moved to a position not overlapping the warning or prohibited area. Therefore, in the case of a warning, in order to place the additional image at a position where it can be arranged, the additional image must be moved again and made to be movable again, and the operation to a position not overlapping the prohibited area There is a problem that it becomes complicated. When the additional image is moved to a position not overlapping the prohibited area, it may be different from the position desired by the user. In this case, an operation for moving the additional image so as to be movable again is performed. Must. Therefore, there is a problem that the operation of moving the additional image in a movable state again becomes complicated.
JP, 2011-188197, A

  The present invention has been made to solve the above-mentioned problems, and one of the objects of the present invention is to provide an image editing apparatus capable of facilitating an operation of determining a position for arranging an additional image. It is.

  Another object of the present invention is to provide an image editing method capable of facilitating an operation of determining a position where an additional image is to be arranged.

  Still another object of the present invention is to provide an image editing program capable of facilitating an operation of determining a position for arranging an additional image.

According to an aspect of the present invention for achieving the above object, an image editing apparatus includes a display means capable of displaying an image, and a position detection means for detecting a position designated by a user on a display surface of the display means. Operation determination means for determining an operation by the user based on the detected position, a preview image display means for displaying the image of the data as a preview image on the display means, and an additional image for combining with the image of the data and additional image display means for displaying the unit, in response to the first operation is determined, and the movable state setting means for setting an additional image to the moving state movable in a display surface, a movable state In response to the second operation being determined while being set, the additional image is moved to the position detected by the position detection means at the time when the second operation in the display surface is determined. And additional image moving means, between a movable state, on the basis of the image to be arranged in the additional image and the preview image, an auxiliary means for assisting the user interaction, after the second operation is determined, the movable state And the auxiliary means, after the second operation is determined, when the additional image after being moved by the additional image moving means and the overlap prohibited area in the preview image do not overlap. It includes release extension means for inhibiting release of the movable state by the release means for a predetermined time .

According to this aspect, in response to the determination of the first operation, the additional image is set to be movable in the display surface, and the second operation is determined while being set to be movable. And the additional image is moved to the position detected at the time when the second operation in the display surface is determined, and the additional image and the image to be arranged in the preview image are in the movable state. Assist the user in the operation based on. For this reason, since the user's operation is assisted while moving the additional image in the preview image, it is possible to provide an image editing apparatus capable of facilitating the operation of determining the position where the additional image is to be arranged. Can. In addition, when the additional image after being moved and the overlap prohibited area in the preview image do not overlap, the release of the movable state is prohibited only for a predetermined time after the second operation is determined. Since the additional image can be moved without performing the first operation for a predetermined time after the operation of is determined, the operation of determining the position of the additional image can be facilitated.
According to another aspect of the present invention, the image editing apparatus includes display means capable of displaying an image, position detection means for detecting a position designated by the user on the display surface of the display means, and a detected position. Operation determination means for determining the operation by the user based on the preview image display means for displaying the data image as the preview image on the display means, and additional image display for displaying the additional image to be combined with the data image on the display means Means, movable state setting means for setting the additional image in the movable state in the display surface in response to the determination of the first operation, and setting of the additional image in the movable state; An additional image moving means for moving the additional image to a position detected by the position detection means when the second operation on the display surface is determined according to the determination of the second operation; During the state, based on the additional image and the image arranged in the preview image, at the two or more positions detected at different times by the position detecting means, the auxiliary means for assisting the user's operation and the movable state. Based on the movement direction determination means for determining the movement direction, and a blank area in the preview image, the blank area being disposed in the movement direction determined from the position detected by the position detection means and detected by the position detection means Candidate area determining means for determining a blank area having the shortest distance from the position as the candidate area, and the additional image moving means is continuously moved by the position detecting means while being set in the movable state. When it is detected, the additional image is arranged at the position detected each time the position is detected by the position detecting means and displayed on the display means, and the auxiliary means is displayed on the display means. The size of the image is changed based on the size of the determined candidate region.
According to this aspect, while in the movable state, the movement direction of the additional image is determined, and a blank space area in the preview image is disposed from the detected position in the movement direction and from the detected position. Since the blank area with the shortest distance is determined as the candidate area and the size of the additional image is changed based on the size of the candidate area, the blank area with high possibility of the additional image being arranged in the preview image is set as the candidate area It is possible to determine and change the size of the additional image to a size that fits in the candidate area. Therefore, the operation of arranging the additional image in the preview image can be facilitated.

Preferably, the apparatus further comprises release means for releasing the movable state after the second operation is determined, wherein the auxiliary means is configured to prevent the additional image after being moved by the additional image moving means and the overlap prohibited area in the preview image. And a release extension means for prohibiting release of the movable state by the release means for a predetermined time after the second operation is determined.
According to this aspect, when the additional image after being moved and the overlap prohibited area in the preview image do not overlap, the release of the movable state is prohibited for a predetermined time after the second operation is determined. Therefore, since the additional image can be moved without performing the first operation for a predetermined time after the second operation is determined, the operation of determining the position of the additional image can be facilitated.
Preferably, the auxiliary means includes release inhibiting means for inhibiting release of the movable state by the releasing means when the additional image after being moved by the additional image moving means and the overlap prohibited area in the preview image overlap.

  According to this aspect, when the additional image after being moved and the overlap prohibited area in the preview image overlap, since the release of the movable state is prohibited, the additional image is moved without performing the first operation. As a result, it is possible to facilitate the operation of arranging the additional image in a position not overlapping the non-overlapping area in the preview image.

  Preferably, the release extension means lengthens the predetermined time when the preview image is enlarged.

  According to this aspect, since the time for which release of the movable state is prohibited after the second operation is determined is long, the second operation in the case where the preview image is enlarged and displayed is determined. The period in which the additional image can be moved without performing the first operation can be extended, and the operation in the case of accurately determining the position of the additional image can be facilitated.

  Preferably, the image processing apparatus further comprises designated area determination means for determining the designated area of the instructed area based on a plurality of positions detected at one time by the position detection means, and the release extension means is determined as the area of the additional image Based on the designated area, a predetermined time is determined.

  According to this aspect, the designated area of the designated area is determined based on the plurality of positions detected at one time, and the predetermined time is determined based on the area of the additional image and the designated area. It is possible to facilitate the operation of determining the position of the additional image when the user's finger hides part of the additional image and it becomes difficult to check the position of the additional image in the preview image while designating the additional image. .

  Preferably, the non-overlapping area includes an area other than the blank area in the preview image.

  According to this aspect, since the area other than the blank area is set as the non-overlap area, it is possible to prevent the additional image from overlapping the image arranged in the preview image.

  Preferably, when the data includes a plurality of pages, the preview image display means displays one of the images of the plurality of pages as a preview image on the display surface of the display means, and the overlap prohibited area is blank in all of the plurality of pages. It includes areas other than the common blank area where

  According to this aspect, when the data includes a plurality of pages, an area other than the common blank area, which is blank in all of the plurality of pages, is set as the overlap prohibited area. It is possible to facilitate the operation of arranging the additional image at a position where the additional image does not overlap with other images.

  Preferably, the preview image display means displays the preview image before the image of the data is formed on the recording medium by the image forming apparatus capable of forming an image on the recording medium, and the overlap prohibited area is an image by the image forming apparatus. It includes unprintable areas that can not be formed.

  According to this aspect, since the non-printable area in which image formation by the image forming apparatus can not be performed is set as the overlap prohibited area, the operation of arranging the additional image at the image formable position can be facilitated.

  Preferably, the auxiliary means is an outline image display means for displaying an outline image indicating a positionable area which is a blank area in the preview image and is larger than the size of the additional image while being movable, on the preview image. including.

  According to this aspect, while in the movable state, an outline image indicating a positionable area which is a blank area in the preview image and is larger than the size of the additional image is superimposed and displayed on the preview image. Therefore, since the locatable area in which the additional image can be arranged is shown in the preview image, the user can easily determine the position of the additional image.

  Preferably, the apparatus further comprises: a predetermined area detection means for detecting a predetermined area predetermined for arranging the additional image in the preview image, and the auxiliary means is based on the size of the additional image and the size of the predetermined area Change the size of the additional image.

  According to this aspect, the size of the additional image is detected because the predetermined area determined in advance for arranging the additional image is detected, and the size of the additional image is changed based on the size of the additional image and the size of the predetermined area. Can be resized to fit within the default area. Therefore, the operation of arranging the additional image in the preview image can be facilitated.

  Preferably, when the additional image and the image in the preview image overlap, the auxiliary means selectively displays a candidate image of the complementary color of the color of the image overlapping with the additional image or having the same shape as that of the additional image. The candidate image display means is included.

  According to this aspect, when the additional image and the image in the preview image overlap, the candidate image having the same shape as the additional image and the complementary color of the color of the image overlapping the additional image or the similar color is displayed in a selectable manner. The operation of changing the color of the additional image can be facilitated.

According to another aspect of the present invention, the image editing method is an image editing method executed by the image editing apparatus, and the image editing apparatus includes display means capable of displaying an image and a display surface of the display means. An operation determination step of determining an operation by the user based on the position detected by the position detection means, and position display means for detecting the position instructed by the user; and displaying an image of the data as a preview image on the display means Moving the additional image in the display surface according to the preview image display step of performing, the additional image display step of displaying on the display means an additional image to be combined with the data image, and the first operation being determined a movable state setting step of setting a movable state capable, in response to the second operation is determined during set in the movable state, displaying an additional image Based on the additional image moving step of moving to the position detected by the position detection means at the time when the second operation in the middle is determined, and the additional image and the image arranged in the preview image during the movable state. The auxiliary step for assisting the operation by the user, and the releasing step for releasing the movable state after the second operation is determined, the auxiliary step including the additional image after being moved in the additional image moving step When the overlap prohibition area in the preview image does not overlap, the release extension step is configured to prohibit release of the movable state in the release step for a predetermined time after the second operation is determined .

According to this aspect, it is possible to provide an image editing method capable of facilitating the operation of determining the position where the additional image is to be arranged.
According to still another aspect of the present invention, the image editing method is an image editing method executed by the image editing device, and the image editing device includes display means capable of displaying an image, and a display surface of the display means. Operation detecting step of determining an operation by the user based on the detected position, and a preview image for displaying an image of the data as a preview image on the display means. A display step, an additional image display step for displaying an additional image to be combined with an image of the data on the display means, and a movable movement of the additional image on the display surface according to the determination of the first operation In the movable state setting step of setting to the possible state, and in response to the determination of the second operation while the movable state is set, the second image on the display surface is displayed. Assists the user's operation based on the additional image moving step of moving to the position detected by the position detection means when the operation is determined, and the additional image and the image arranged in the preview image during the movable state A moving direction determining step of determining the moving direction based on two or more positions detected at different times by the position detecting means during the movable state, and a blank space area in the preview image. And a candidate area determining step of determining a blank area located in the moving direction determined from the position detected by the position detecting means and having the shortest distance from the position detected by the position detecting means as a candidate area. In the additional image moving step, when the position detection means continuously detects the position while the movable state is set, the position detection means The step of arranging the additional image at the detected position every time the detection position is detected and displaying it on the display means, the auxiliary step comprises the step of determining the size of the additional image to be displayed on the display means of the determined candidate area. Includes changing based on size.

According to still another aspect of the present invention, the image editing program is an image editing program executed by a computer that controls the image editing apparatus, and the image editing apparatus includes display means capable of displaying an image, and display means Operation detection step of determining an operation by the user based on the position detected by the position detection means; and a position detection means for detecting the position instructed by the user on the display surface of the image; As a preview image display step displayed on the display means as an image, an additional image display step displaying an additional image to be combined with the data image on the display means, and the first image being determined in response to the determination of the first operation. a movable state setting step of setting a movable state movable in the display surface, the second steering while being set on a movable state Moving the additional image to the position detected by the position detection means at the time when the second operation in the display surface is determined in response to the determination of Causing the computer to execute an assisting step for assisting the user's operation based on the image and the image arranged in the preview image, and a releasing step for releasing the movable state after the second operation is determined , In the auxiliary step, when the additional image after being moved in the additional image moving step and the overlap prohibited area in the preview image do not overlap, the movable state in the releasing step for a predetermined time after the second operation is determined. Includes a release extension step that prohibits release of the

According to this aspect, it is possible to provide an image editing program capable of facilitating the operation of determining the position where the additional image is to be arranged.
According to still another aspect of the present invention, the image editing program is an image editing program executed by a computer that controls the image editing apparatus, and the image editing apparatus includes display means capable of displaying an image, and display means Operation detection step of determining an operation by the user based on the detected position, and an image of the data as a preview image on the display means. The preview image display step to be displayed, the additional image display step to display the additional image to be combined with the data image on the display means, and the additional image in the display surface according to the determination of the first operation. A movable state setting step of setting the movable state and a second operation being determined while the movable state is set. According to the additional image moving step of moving the additional image to the position detected by the position detection means at the time when the second operation in the display surface is determined, and in the movable state, arranged in the additional image and the preview image Determination of the movement direction based on two or more positions detected at different times by the position detection means during the movable state, and an auxiliary step for assisting the user's operation based on the selected image A step and a blank area in the preview image, the blank area being disposed in the moving direction determined from the position detected by the position detecting means, and the shortest distance from the position detected by the position detecting means The computer executes the candidate area determining step of determining the candidate area as the candidate area, and the additional image moving step performs position detection while being set in the movable state. In the case where the position is continuously detected by the means, including the step of arranging the additional image at the position detected each time the position is detected by the position detection means and displaying it on the display means, the auxiliary step includes Changing the size of the additional image to be displayed based on the size of the determined candidate area.

FIG. 2 is a perspective view showing an appearance of the MFP in one of the embodiments of the present invention. FIG. 2 is a block diagram showing an outline of a hardware configuration of an MFP. It is a top view of an operation panel. FIG. 6 is a block diagram showing an example of functions of a CPU of the MFP in the present embodiment. It is a figure which shows an example of a preview screen. It is a figure which shows an example of a stamp selection screen. It is a figure which shows an example of a stamp setting screen. It is a figure which shows an example of a preview image typically. It is a figure which shows an example of the prohibition area which shows the image in a preview image. FIG. 10 is a first diagram illustrating an example of a prohibited area of a non-printable area in a preview image. It is a 2nd figure which shows an example of the prohibition area | region of the area | region which can not be printed in a preview image. It is a figure which shows an example of the preview image of the state by which the frame of the blank area was displayed. It is a figure which shows the state which designated the additional image with the finger. It is a flowchart which shows an example of the flow of the image edit process in this Embodiment. It is a flow chart which shows an example of the flow of processing under movement. It is a flow chart which shows an example of a flow of display processing under movement. It is a flowchart which shows an example of the flow of extension time determination processing.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the following description, the same components are denoted by the same reference numerals. Their names and functions are also the same. Therefore, detailed description about them will not be repeated.

  FIG. 1 is a perspective view showing the appearance of an MFP according to an embodiment of the present invention. FIG. 2 is a block diagram showing an outline of the hardware configuration of the MFP. Referring to FIGS. 1 and 2, MFP 100 functioning as an image editing apparatus includes main circuit 110, an original reading unit 130 for reading an original, and an automatic original conveying apparatus for conveying an original to original reading unit 130. 120, an image forming unit 140 for forming an image on a sheet based on image data which the document reading unit 130 reads and outputs a document, and a sheet feeding unit 150 for supplying the sheet to the image forming unit 140 , And an operation panel 160 as a user interface.

  The main circuit 110 controls a whole of the MFP 100, a communication interface (I / F) unit 112, a ROM 113, a RAM 114, a hard disk drive (HDD) 115 as a mass storage device, and a facsimile unit 116. And an external storage device 117. The CPU 111 is connected to the automatic document feeder 120, the document reading unit 130, the image forming unit 140, the paper feeding unit 150, and the operation panel 160, and controls the entire MFP 100.

  The automatic document feeder 120 automatically conveys a plurality of documents set on the document feeding tray one by one to a predetermined document reading position set on the platen glass of the document reading unit 130 and reading the documents A document whose document image has been read by the unit 130 is discharged onto a document discharge tray. The document reading unit 130 includes a light source for irradiating light to the document conveyed to the document reading position, and a photoelectric conversion element for receiving light reflected from the document, and scans a document image according to the size of the document. The photoelectric conversion element converts the received light into image data which is an electric signal, and outputs the image data to the image forming unit 140. The sheet feeding unit 150 conveys the sheet stored in the sheet feeding tray to the image forming unit 140.

  The image forming unit 140 forms an image by a known electrophotographic method, and image data after data processing in which various data processing such as shading correction is performed on the image data input from the document reading unit 130 Alternatively, an image is formed on the sheet conveyed by the sheet feeding unit 150 based on the image data received from the outside.

  The facsimile unit 116 is connected to a public switched telephone network (PSTN), transmits facsimile data to the PSTN, or receives facsimile data from the PSTN. The facsimile unit 116 stores the received facsimile data in the HDD 115, converts the received facsimile data into print data printable by the image forming unit 140, and outputs the print data to the image forming unit 140. Thus, the image forming unit 140 forms an image on a sheet of facsimile data received by the facsimile unit 116. In addition, the facsimile unit 116 converts the data stored in the HDD 115 into facsimile data, and transmits the data to a facsimile apparatus connected to the PSTN.

  Communication I / F unit 112 is an interface for connecting MFP 100 to the network. The communication I / F unit 112 communicates with another computer or data processing apparatus connected to the network by a communication protocol such as TCP (Transmission Control Protocol) or FTP (File Transfer Protocol). The network to which the communication I / F unit 112 is connected is a local area network (LAN), and the connection form may be wired or wireless. The network is not limited to a LAN, and may be a wide area network (WAN), a public switched telephone network (PSTN), the Internet, or the like.

  The ROM 113 stores a program executed by the CPU 111 or data necessary for executing the program. The RAM 114 is used as a work area when the CPU 111 executes a program. Further, the RAM 114 temporarily stores read images continuously sent from the document reading unit 130.

  Operation panel 160 is provided on the top surface of MFP 100. Operation panel 160 includes a display unit 161 and an operation unit 163. The display unit 161 is, for example, a liquid crystal display (LCD), and displays an instruction menu for the user, information on acquired image data, and the like. Note that, in place of the LCD 165, for example, an organic EL (Electroluminescence) display can be used as long as it is an apparatus that displays an image.

  Operation portion 163 includes touch panel 165 and hard key portion 167. The touch panel 165 is a capacitive type. The touch panel 165 is not limited to the electrostatic capacitance type, but may be another type such as a resistive film type, a surface acoustic wave type, an infrared type, or an electromagnetic induction type.

  The touch panel 165 is provided such that the detection surface thereof is superimposed on the display unit 161 on the upper surface or the lower surface of the display unit 161. Here, the size of the detection surface of the touch panel 165 and the size of the display surface of the display unit 161 are the same. For this reason, the coordinate system of the display surface and the coordinate system of the detection surface are the same. The touch panel 165 detects the position at which the user instructs the display surface of the display unit 161 on the detection surface, and outputs the coordinates of the detected position to the CPU 111. Since the coordinate system of the display surface and the coordinate system of the detection surface are the same, the coordinates output from the touch panel 165 can be replaced with the coordinates of the display surface. Hereinafter, the coordinates detected and output by the touch panel 165 on the detection surface when the user designates the display surface of the display unit 161 are also referred to as the coordinates of the display surface.

  Hard key portion 167 includes a plurality of hard keys. The hard key is, for example, a contact switch. The touch panel 165 detects the position designated by the user on the display surface of the display unit 161. When the user operates the MFP 100, the display surface of the display unit 161, the operation surface of the touch panel 165, and the hard key unit 167 are arranged facing upward since the posture is often upright. This is to allow the user to easily view the display surface of the display unit 161 and to easily instruct the operation unit 163 with a finger.

  The external storage device 117 is controlled by the CPU 111, and a compact disk read only memory (CD-ROM) 118 or a semiconductor memory is mounted. In the present embodiment, an example in which the CPU 111 executes a program stored in the ROM 113 will be described. However, the CPU 111 controls the external storage device 117 to read a program to be executed by the CPU 111 from the CD-ROM 118 The read program may be stored in the RAM 102 and executed.

  The recording medium for storing the program to be executed by the CPU 111 is not limited to the CD-ROM 118, and a flexible disc, a cassette tape, an optical disc (Magnetic Optical Disc) / MD (Mini Disc) / DVD (Digital Versatile Disc) ), IC card, optical card, mask ROM, semiconductor memory such as EPROM (Erasable Programmable ROM), EEPROM (Electrically EPROM), etc. may be used. Furthermore, the CPU 111 downloads a program from a computer connected to the network and stores the program in the HDD 115, or a computer connected to the network writes the program to the HDD 115 and loads the program stored in the HDD 115 to the RAM 114 Then, the program may be executed by the CPU 111. The program referred to here includes not only a program directly executable by the CPU 111 but also a source program, a compressed program, an encrypted program and the like.

  FIG. 3 is a plan view of the operation panel 160. As shown in FIG. Referring to FIG. 3, operation panel 160 includes display portion 161, touch panel 165 superimposed on display portion 161, and start key 171, BOX key 173, and COPY key on the right and lower side of display portion 161. And a hard key portion 167 in which a plurality of hard keys including a 175 and a fax key 177 are arranged.

  FIG. 4 is a block diagram showing an example of functions of the CPU of the MFP in the present embodiment. The function illustrated in FIG. 4 is a function configured by the CPU 111 when the CPU 111 included in the MFP 100 executes an image editing program stored in the ROM 113, the HDD 115, or the CD-ROM 118. Referring to FIG. 4, CPU 111 includes operation determining unit 31, display control unit 33 for controlling display unit 161, movable state setting unit 35, canceling unit 37, determination unit 39, and auxiliary unit 41. , A movement direction determination unit 43, a designated area determination unit 45, a blank area determination unit 47, a candidate area determination unit 49, a predetermined area detection unit 51, and a composite image generation unit 71 that combines the additional image with the data image. And an image forming control unit 73 that controls the image forming unit 140.

  The operation determination unit 31 instructs the display control unit 33 to display an operation screen for receiving a user's operation, and determines an operation input to the operation unit 163 by the user according to the operation screen. Specifically, the operation determining unit 31 outputs, to the display control unit 33, a display instruction including screen identification information for identifying the operation screen. At an initial stage, the operation determination unit 31 outputs a display instruction including screen identification information of a predetermined operation screen to the display control unit 33. The initial stage is, for example, when the MFP 100 is powered on or when it recovers from a sleep state where power consumption is low.

  Display control unit 33 reads the operation screen specified by the screen identification information included in the display instruction from HDD 115 in response to the display instruction being input from operation determining unit 31, and displays the read operation screen. Displayed on the part 161.

  The operation determination unit 31 controls the touch panel 165. After outputting the screen identification information to the display control unit 33, the operation determining unit 31 determines an operation by the user based on the coordinates input from the touch panel 165 in response to the coordinates being input from the touch panel 165. Operation determining unit 31 specifies the position designated by the user on the operation screen based on the coordinates input from touch panel 165. Specifically, an operation is performed by converting the position specified by the coordinates input from touch panel 165 in the image of the operation screen displayed on display portion 161 into the position in the operation screen instructed by the user. Decide.

  The operation determining unit 31 determines an operation corresponding to the position specified in the operation screen. For example, when the operation screen includes an execution instruction button to which an operation instructing the execution of processing is assigned, if the position instructed by the user in the operation screen is within the range of the execution instruction button, the execution instruction operation is Identify.

  In addition, when the operation screen includes a transition button to which another operation screen is assigned, the operation determining unit 31 transitions the screen if the position designated by the user in the operation screen is within the range of the transition button. Identify the operation to be performed. When specifying the operation of transitioning the screen, the operation determining unit 31 outputs a display instruction including the screen identification information of the operation screen assigned to the transition button to the display control unit 33. The operation screen includes a preview screen. When the operation screen includes the transition button to which the preview screen is assigned, the operation determining unit 31 displays the preview screen if the position designated by the user in the operation screen is within the range of the transition button to which the preview screen is assigned. Identify the operation that transitions to When specifying the operation for transitioning to the preview screen, the operation determining unit 31 outputs a display instruction including the screen identification information of the preview screen to the display control unit 33. The display control unit 33 displays the preview screen on the display unit 161 in response to the display instruction including the screen identification information of the preview screen being input from the operation determination unit 31.

  FIG. 5 is a diagram showing an example of the preview screen. Referring to FIG. 5, preview screen 300 has a preview area 301 for displaying a preview image, a pop-down button 303 in which the characters “stamp” are displayed, and a pop-up button 305 in which the characters “stamp” are displayed. And transition buttons 311 to 316. The pop-up button 303 is associated with the stamp selection screen. The stamp selection screen is a pop-up screen, and is displayed superimposed on the preview screen. The pop-up button 305 is associated with the stamp setting screen. The stamp setting screen is a pop-up screen, and is displayed superimposed on the preview screen.

  FIG. 6 is a diagram showing an example of the stamp selection screen. Referring to FIG. 6, stamp selection screen 330 is a pop-up screen associated with pop-up button 303 in which the characters of the stamp are displayed. The stamp selection screen 330 includes selection buttons 331 to 338 and a determination button 339 in which the character of OK is displayed. The selection buttons 331 to 338 are associated with any of the plurality of stamp images. In the determination button 339, a command for determining a stamp image and a command for ending the display of the stamp selection screen 330 are associated.

  FIG. 7 is a diagram showing an example of the stamp setting screen. Referring to FIG. 7, the stamp setting screen includes page setting buttons 351 and 352 for setting a page for combining stamp images, size setting buttons 353 to 355 for setting a stamp image size, and OK. And a decision button 359 in which the character is represented. The page setting button 351 is associated with a command to set a page for combining stamp images to all pages. The page setting button 352 is associated with a command for setting a page for combining stamp images as the first page. The size setting button 353 is associated with a command for setting the size of the stamp image to the largest size “large”. The size setting button 355 is associated with a command for setting the size of the stamp image to the smallest size “small”. A size setting button 354 is associated with a command for setting the size of the stamp image to “medium” which is smaller than the largest size and larger than the smallest size. The determination button 359 is associated with a command for determining the page on which the stamp image is to be synthesized and the size of the stamp image, and a command for ending the display of the stamp setting screen 350.

  Returning to FIG. 4, the display control unit 33 includes a preview image display unit 53 and an additional image display unit 55. While the preview screen 300 is displayed on the display unit 161, the preview image display unit 53 displays an image of data set as a processing target in the preview area 301 of the preview screen 300 as a preview image. The data set as the processing target is data specified as the processing target by the user, and includes image data that the document reading unit 120 reads and outputs a document, and data stored in the HDD 115. The data stored in the HDD 115 includes facsimile data received by the facsimile unit 116 and application data generated by the CPU 111 executing an application program. Also, data stored in the HDD 115 includes data received from an external computer. The preview image display unit 53 outputs the preview image and the position of the preview image in the operation screen to the overlap determination unit 39 and the default area detection unit 51.

  While the preview screen 300 is displayed on the display unit 161, the additional image display unit 55 superimposes the additional image on the preview screen 300 and displays the superimposed image. Specifically, in the state where the stamp selection screen 330 is displayed on the display unit 161, the additional image display unit 55 performs an operation of instructing one of the selection buttons 331 to 338, for example, the selection button 331 by the operation determination unit 31. Is determined, the stamp image associated with the instructed selection button 331 is determined as the additional image. After the additional image display unit 55 determines the additional image, when the operation determination unit 31 determines an operation of instructing the determination button 339 representing the character of OK, the display of the stamp selection screen 330 ends, and The additional image is superimposed and displayed on the preview screen 300 in a predetermined size.

  In addition, when the additional image display unit 55 displays the stamp image, any one of the size setting buttons 353 to 355 by the operation determination unit 31, for example, the size, with the stamp setting screen 350 being displayed on the display unit 161. The size of the stamp image is determined to the size associated with the instructed size setting button 351 in response to the determination of the operation for instructing the setting button 351. After the size of the additional image is determined, the additional image display unit 55 ends the display of the stamp setting screen 350 when the operation determining unit 31 determines the operation of instructing the determination button 359 in which the character of OK is displayed. At the same time, the additional image is superimposed and displayed on the preview screen 300 at the determined size.

  In the state where the stamp setting screen 350 is displayed on the display unit 161, the additional image display unit 55 combines the stamp image in response to the operation determining unit 31 determining the operation specifying the page setting button 351. A page is set to all pages, and in response to the operation determining unit 31 determining an operation to instruct the page setting button 352, a page on which a stamp image is to be combined is set to the first page.

  The preview image display unit 53 displays, as a preview image, an image of pages subsequent to the second page among a plurality of pages included in the processing target data, in a case where the page to be composited with the stamp image is set to the first page. In the case where the additional image is displayed by the additional image display unit 55, the image of the first page among the plurality of pages included in the processing target data is displayed as a preview image.

  The operation determination unit 31 determines the first operation in a state where the additional image is displayed on the display unit 161. The first operation is an operation of selecting an additional image, and is an operation in which the user designates the additional image with a finger or a stylus pen. Here, the first operation is an operation in which the user continuously designates the additional image for a predetermined time with a finger or a stylus pen. Operation determination unit 31 performs the first operation in response to the coordinates within the range of the additional image in the image of the operation screen being displayed on display unit 161 being continuously input from touch panel 165 for a predetermined time. decide. The operation determination unit 31 outputs the first signal to the movable state setting unit 35 in response to the determination of the first operation.

  The movable state setting unit 35 sets the movable state in response to the input of the first signal from the operation determination unit 31. The movable state setting unit 35 outputs a state signal indicating the movable state to the additional image display unit 55 and the operation determination unit 31 while the movable state is set.

  The operation determination unit 31 determines a second operation for determining the position of the movement destination of the additional image in the state in which the movement is enabled. The second operation is an operation in which the user uses a finger or a stylus to indicate the position of the movement destination of the additional image. Operation determining unit 31 outputs the second signal to canceling unit 37 in response to determining the second operation.

<In the case of drag and drop operation>
The second operation is an operation of ending the instruction of the additional image indicated by the user with a finger or a stylus pen while being set in the movable state. For example, when the user designates an additional image for a predetermined time with a finger or a stylus pen, the first operation is determined. Thereafter, while the instruction is continued with the finger or the stylus pen, in other words, after the display surface of the display unit 161 is moved while maintaining the state in contact with the display surface of the display unit 161, the finger or the stylus pen The operation of releasing from can be the second operation. The operation determining unit 31 determines the second operation when the coordinates input from the touch panel 165 are not input after being set in the movable state.

<In case of tap operation>
The second operation is an operation in which the user designates a position in the operation screen with a finger or a stylus pen while being set in the movable state. When the user designates an additional image with a finger or a stylus for a predetermined time, the first operation is determined and set to be movable. After being set in the movable state, an operation of releasing a finger or a stylus pen from the display surface of the display portion 161 and then instructing a position in the operation screen with the finger or the stylus pen can be set as a second operation. After being set in the movable state, the operation determining unit 31 does not receive the coordinates input from the touch panel 165, and thereafter determines the second operation in response to the coordinates being input from the touch panel 165. .

  The first operation and the second operation are not limited to the above-described operation, and may be an operation distinguishable from other operations by combining the position instructed by the user on the operation screen, the instructed time, and the like. In the following description, the case of determining the second operation using a drag and drop operation will be described as an example.

  In response to the second signal being input from the operation determination unit 31, the release unit 37 releases the movable state on the condition that the prohibition signal or the extension signal is not input by the auxiliary unit 41 described later. The releasing unit 37 outputs a state signal indicating that the movable state is released to the additional image display unit 55 and the operation determining unit 31 in response to releasing the movable state.

  The additional image display unit 55 includes an additional image moving unit 57. While being set in the movable state, the additional image moving unit 57 moves the additional image to a position in the operation screen specified by the coordinates output by the touch panel 165. In addition, the additional image moving unit 57 outputs coordinates of the additional image at the time when the second operation on the display surface is determined in response to the second operation being determined by the operation determining unit 31. Move to the position in the operation screen specified by. When moving the additional image, the additional image display unit 55 outputs the position of the additional image and the position of the additional image after movement in the operation screen to the overlap determination unit 39 and the movement direction determination unit 43.

  The overlap determination unit 39 receives the preview image and the position of the preview image in the operation screen from the preview image display unit 53, and the additional image from the additional image display unit 55 and the position in the operation screen of the additional image. Ru. The overlap determination unit 39 determines the overlap between the additional image and the prohibited area in the preview image. The prohibited area includes a rectangular area in which the image to be arranged in the preview image is represented. In other words, the prohibited area includes a non-blank rectangular area of the preview image. The overlap determination unit 39 binarizes the preview image, and determines a rectangular area including pixels whose value is “1” as an area in which the image is displayed. For example, the length between the position where there is at least one pixel with a value of “1” and the position where there is no pixel with a value of “1” will be Length in the direction, and the length between the position where the preview image is scanned in the horizontal direction and there is at least one pixel with a value of "1" to the position where there is no pixel with a value of "1" A rectangular area having a length in the horizontal direction is determined as the rectangular area in which the image is represented. Note that there are cases where a plurality of areas with the same position in the vertical direction but different positions in the horizontal direction may be considered as rectangular areas representing images, and a plurality of regions with the same horizontal position but different positions in the vertical direction. The region of may be a rectangular region in which the image is represented.

  In addition, the prohibited area includes an area in the preview image where the image forming unit 140 can not print. The area which can not be printed by the image forming unit 140 is an area of a predetermined length from the end of the preview image. Further, in the area where the image forming unit 140 can not print is, in the case where the preview image is an image obtained by combining a plurality of pages, for example, in the case where the preview image is an image obtained by combining two pages, Includes an area of a predetermined length from the end.

  When the page to be combined with the stamp image is set to the first page, the overlap determination unit 39 determines whether the additional image overlaps the prohibited area in the preview image. When at least a part of the additional image overlaps with at least a part of the prohibited area, the overlap determination unit 39 determines that both overlap. When the overlap determination unit 39 determines that the additional image and the prohibited area overlap, the overlap determination unit 39 outputs an overlap signal indicating that the auxiliary unit 41 is overlapping.

  Further, when the page to be composited with the stamp image is set to all pages, the overlap determination unit 39 determines whether the additional image overlaps the prohibited area in each of the plurality of pages included in the data to be processed. To judge. The overlap determination unit 39 determines a prohibited area for each of a plurality of pages, and when at least a part of the additional image overlaps with at least a part of any of the prohibited areas of a plurality of pages, the additional image becomes data to be processed. It is determined to overlap with the prohibited area in the image of each of the plurality of included pages. When it is determined that the additional image overlaps with any of the prohibited areas of each of the plurality of pages, the overlap determination unit 39 outputs an overlap signal indicating that the auxiliary unit 41 has an overlap.

  The blank area determination unit 47 determines a rectangular area in which the image is not represented in the preview image as a blank area. An area where an image is not represented in the preview image can be detected as a set of pixels whose value becomes “0” by binarizing the preview image. For example, the length between the position where there is at least one pixel with a value of “0” and the position where there is no pixel with a value of “0” will be The length in the direction, and the length between the position where there is at least one pixel with a value of “0” and the position where there is no pixel with a value of “0”, by scanning the preview image in the horizontal direction A rectangular area having a length in the horizontal direction is determined as a blank area. A plurality of areas having the same position in the vertical direction but different positions in the horizontal direction may be blank areas, and a plurality of areas having the same position in the horizontal direction but different positions in the vertical direction may be blank areas. May be The blank area determination unit 47 outputs blank area information indicating the positions of the determined one or more blank areas in the preview image to the auxiliary unit 41 and the candidate area determination unit 49. The blank area may have a size larger than the size of the additional image. A blank area can be a blank area that can be arranged without making the size of the additional image different.

  The movement direction determination unit 43 determines the movement direction of the additional image. The movement direction determination unit 43 receives the position of the additional image in the operation screen from the additional image movement unit 57. The movement direction determination unit 43 determines the position and movement direction of the additional image before the movement based on the position in the operation screen of the additional image at different times. Specifically, movement direction determination unit 43 determines the position of the additional image at the first time in the operation screen and the position of the additional image at the second time after the first time in the operation screen. The direction in which the additional image has moved from time 1 to the second time is determined, and the position in the operation screen of the additional image at the first time and the determined moving direction are output to the candidate area determination unit 49.

  The candidate area determination unit 49 receives blank area information of each of the one or more blank areas from the blank area determination unit 47, and receives from the movement direction determination unit 43 the position and movement direction of the additional image on the operation screen. The candidate area determination unit 49 determines one of the one or more blank areas as a candidate area. Specify the position of each one or more blank areas in the operation screen, and exist in the moving direction from the position in the operation screen of the additional image among the one or more blank areas, and select the blank area with the shortest distance from the additional image as a candidate area Decide on. The candidate area determination unit 49 outputs the blank area information of the candidate area to the auxiliary unit 41.

  The designated area determination unit 45 determines the area of the touch of the user's finger on the touch panel 165. The area where the user's finger touches the touch panel 165 is referred to as a designated area. The designated area determination unit 45 controls the touch panel 165 to determine the designated area from a plurality of coordinates simultaneously detected by the touch panel 165. The designated area determination unit 45 outputs the determined designated area to the auxiliary unit 41.

  The default area detection unit 51 receives the preview image and the position of the preview image on the operation screen from the preview image display unit 53. When the additional image is a predetermined default image, the default area detection unit 51 analyzes the preview image to detect a default area corresponding to the default image in the preview image. The default image is a stamp image in which the position to be arranged is determined by the image to be synthesized. Here, the default image is an image of a seal or a signature. The default area is an area defined by the image to arrange the stamp image. For example, the predetermined area is an area to be stamped on a stamp image that is an image of a seal stamp, and an area to sign on a stamp image that is an image of a signature. In this case, a stamp image which is an image of a seal stamp or an area corresponding to a stamp image which is an image of a signature is a character string such as “mark”, “signature” or “sign” in the area or in the vicinity of the area. May be included. The default area detection unit 51 character-recognizes the preview image, and determines whether a character string of “mark”, “signature” or “sign” is included in the preview image. When the default area detection unit 51 determines that the preview image includes the character string of “mark”, “signature” or “sign”, the preview image is one of the blank areas in which no character or image is represented in the preview image. The nearest blank area is detected as the default area from the position at which the character string "sign", "signature" or "signature" is represented. Further, there may be a case where a stamp image which is an image of a seal stamp or an area corresponding to a stamp image which is an image of a signature is arranged in the vicinity of the side of a name or the like. The default area detection unit 51 performs character recognition on the preview image, and determines whether the character string of the user's name is included in the preview image. When the default area detection unit 51 determines that the preview image includes the character string of the user's name, the character string of the user's name in the preview image among the blank regions in which no character or image is represented in the preview image The nearest blank area from the position where is represented is detected as a default area. The default area detection unit 51 outputs the blank area information of the default area to the auxiliary unit 41 when detecting the default area.

  The auxiliary unit 41 assists the user's operation based on the size of the additional image and the image arranged in the preview image while being set in the movable state. The auxiliary unit 41 includes a candidate image display unit 61, a release prohibition unit 63, a release extension unit 65, an outline image display unit 67, and a size change unit 69.

  When the overlap signal is input from the overlap determination unit 39 to the candidate image display unit 61, the additional image overlaps with the image arranged in the preview image. In the candidate image display unit 61, when an overlap signal is input from the overlap determination unit 39, one or more candidates having the same shape as the additional image and having a different color when overlap with the image is permitted. The image is superimposed and displayed on the operation screen displayed on the display unit 161 in a selectable manner. The color of the candidate image is preferably a complementary color of the color at the position where the additional image overlaps in the preview image or a color close to the complementary color. Thus, even when the additional image overlaps the image in the preview image, the additional image can be distinguished from the preview image and synthesized with the preview image.

  When the overlap signal is input from the overlap determination unit 39, the release prohibition unit 63 outputs a prohibition signal to the release unit 37 in order to prohibit the release of the movable state by the release unit 37. The release prohibition unit 63 outputs a prohibition signal to the release unit 37 while the overlap signal is input from the overlap determination unit 39. When the release signal is input from the release prohibition unit 63 when the second signal is input from the operation determination unit 31, the release unit 37 does not release the movable state. If the release of the movable state by the release unit 37 is prohibited, the movable state is maintained when the user inputs a second operation to release the finger from the additional image, so the first state for setting the movable state is performed. It is not necessary to input the operation of and it is possible to immediately input the operation of moving the additional image.

  The release extension unit 65 is a release unit for extending the release of the movable state by the release unit 37 for a first period when the extension of release is set when the overlap signal is not input from the overlap determination unit 39. The first extension signal is output to 37. The setting of extension of cancellation is set by the user setting in MFP 100 in advance. Further, an attribute indicating permission or non-permission of overlap may be added to the additional image, and extension of release may be set when the attribute is set to be non-permission of overlap. When the first extension signal is input, the release unit 37 releases the movable state when the first period elapses after the second signal is input from the operation determination unit 31. When the release of the movable state is extended for a first period, the position of the additional image is determined when the user inputs a second operation for releasing the finger from the additional image, and the movable state is only for the first period. Maintained. Although the position of the additional image at the time when the user inputs the second operation may be different from the position desired by the user, the movable state is maintained for only the first period after the input of the second operation Therefore, there is no need to input the first operation, and an operation to move the additional image can be immediately input.

  The release extension unit 65 receives the designated area from the designated area determination unit 45. The release extension unit 65 performs a second extension in order to extend the release of the movable state by the release unit 37 for a second period when the ratio of the designated area to the area of the additional image is equal to or greater than a predetermined threshold value. Output a signal. Although not limiting, it is preferable to make the second period longer than the first period. When the ratio of the designated area to the area of the additional image is equal to or more than the predetermined threshold value, the user moves the additional image, and a part of the additional image is hidden by the finger of the user. While doing this, it may not be possible to accurately check the position of the additional image. Therefore, by securing the second period as the period for confirming the position of the additional image, the operation for determining the position of the additional image can be facilitated.

  When the preview image is displayed by the preview image display unit 53 as an image obtained by enlarging a part of the page, the cancel extension unit 65 cancels the movable state by the cancel unit 37 as the second The second extension signal is output to extend the period of time. Although not limiting, it is preferable to make the second period longer than the first period. When the preview image is an image obtained by enlarging a part of the page, it is possible to accurately determine the position of the additional image in the preview image. Therefore, by securing the second period as the period for confirming the position of the additional image, the operation for determining the position of the additional image can be facilitated.

  The outline image display unit 67 receives blank area information from the blank area determination unit 47. The outline image display unit 67 superimposes and displays an image indicating the outline of each of the one or more blank areas on the basis of the blank area information. Thereby, the user can be notified of the area where the additional image can be arranged.

  When blank area information of the candidate area is input from the candidate area determination section 49, the size changing section 69 determines the size of the additional image, the size of the candidate area, and the distance between the additional image and the candidate area. Change the size of the additional image. At a stage before the additional image is moved by the additional image moving unit 57, the size of the additional image is a size designated by the user. The size in this case is called the initial size. When the additional image overlaps the candidate area, the size changing unit 69 determines the size of the additional image to be equal to or less than the size of the candidate area. The size in this case is called the size after movement. When the initial size is larger than the post-movement size, the size changing unit 69 determines the size of the additional image to be a size proportional to the distance between the additional image and the candidate area. If the initial size is smaller than the post-movement size, the size changing unit 69 determines the size of the additional image to be inversely proportional to the distance between the additional image and the candidate area. The size changing unit 69 outputs the size of the additional image after the change to the additional image display unit 55.

  In addition, the size changing unit 69 receives blank area information of the default area from the default area detecting unit 51. When the additional image displayed by the additional image display unit 55 is a stamp image corresponding to the predetermined area, the size changing unit 69 sets the size of the additional image to a size equal to or less than the size of the predetermined area determined by the blank area information of the predetermined area. change. The size changing unit 69 outputs the size of the additional image after the change to the additional image display unit 55. Also in this case, the size of the additional image may be determined to be proportional to or inversely proportional to the distance between the additional image and the predetermined area.

  The additional image display unit 55 changes the size of the additional image to the size input from the size changing unit 69 in response to the size after the change of the additional image being input from the size changing unit 69, and changes the size The subsequent additional image is displayed on the display unit 161.

  In response to the print instruction being input by the operation determination unit 31, the composite image generation unit 71 generates a composite image obtained by combining the preview image and the additional image, and outputs the generated composite image to the image formation control unit 73. . The position at which the additional image is synthesized with the preview image is the position in the preview image of the additional image displayed by the additional image display unit 55. The image formation control unit 73 controls the image forming unit 140 to form a composite image on a sheet in response to the composite image being input from the composite image generation unit 71.

  FIG. 8 is a view schematically showing an example of the preview image. In FIG. 8, an image of a character is indicated by a symbol ○, and an image of a photograph is indicated by a rectangular region including the characters of Photo 1 and a rectangular region including the characters of Photo 2. Referring to FIG. 8, preview image 500 includes an image of text and an image of a photo.

  FIG. 9 is a view showing an example of the prohibited area showing the image in the preview image. Referring to FIG. 9, preview image 500 shown in FIG. 8 includes a prohibited area 501 including a character image, a prohibited area 502 including a character image and a photo 1 image, and a prohibited area 503 including a character image. And a prohibited area 504 including the image of the picture 2.

  FIG. 10 is a first diagram showing an example of the prohibited area of the unprintable area in the preview image. Referring to FIG. 10, preview image 500 shown in FIG. 8 includes a prohibited area 510 having a predetermined length from the end of preview image 500.

  FIG. 11 is a second diagram showing an example of the prohibited area of the unprintable area in the preview image. Referring to FIG. 11, preview image 600 is an image obtained by combining a plurality of pages, and includes an image 601 of the first page and an image 603 of the second page. In this case, the preview image 600 includes a prohibited area 605 including an area of a predetermined length from the edge of the preview image 600 and an area between the image 601 of the first page and the image 605 of the second page.

  FIG. 12 is a view showing an example of a preview image in a state where a frame of a blank area is displayed. Referring to FIG. 12, an additional image 620 is superimposed and displayed on the preview image 500. In addition, the images 611, 612, 613, and 614 of the frame of the blank area are displayed superimposed on the preview image 500. The images 611, 612, 613, 614 are larger than the size of the additional image 620.

  Further, since the additional image 620 shown in FIG. 12 overlaps the image of the picture 2, the movable state is set when the additional image 620 is not permitted to overlap with the image. In addition, when the additional image 620 is permitted to overlap with the image, if the second operation is accepted in a state where the additional image 620 overlaps with the image of the picture 2, in other words, the additional image 620 becomes the picture 2 When the image is dropped in a state of overlapping with the image, one or more candidate images corresponding to the additional image 620 are displayed. The one or more candidate images in this case are complementary colors or colors similar to the color of the portion of the image of the picture 2 overlapping the additional image 620. If the user indicates any of the candidate images, the color of the additional image is changed to the color of the instructed candidate image, and the movable state is canceled.

  FIG. 13 is a diagram showing a state in which the additional image is indicated by a finger. Referring to FIG. 13, in a state where the user points the additional image 620 with a finger, a region 630 indicated by the user's finger in the additional image 620 is not visible by the user's finger.

  FIG. 14 is a flow chart showing an example of the flow of the image editing process in the present embodiment. The image editing process is a process executed by CPU 111 when CPU 111 of MFP 100 executes an image editing program stored in ROM 113, HDD 115 or CD-ROM 118. Referring to FIG. 14, CPU 111 determines whether an instruction to display a preview screen has been received (step S01). The process waits until an instruction to display the preview screen is received (NO in step S01), and if an instruction to display the preview screen is received (YES in step S01), the process proceeds to step S02. When the user operates operation panel 160 to designate a transition button to which a preview screen is assigned, an instruction to display the preview screen is accepted.

  In the next step S02, processing target data is determined. When an instruction to display the preview screen is received, the data set as the process target is determined as the process target data. The data set as the processing target is data specified as the processing target by the user, and includes image data that the document reading unit 120 reads and outputs a document, and data stored in the HDD 115.

  In the next step S03, a preview screen is displayed, and the process proceeds to step S04. Here, the case where the preview screen 300 shown in FIG. 5 is displayed on the display unit 161 will be described as an example. The preview screen 300 includes a preview area 301 in which an image of data set as a processing target is displayed. In step S04, it is determined whether an additional image has been selected. In response to the user instructing the pop-down button 303 representing the character of the stamp included in the preview screen 300 and instructing one of the selection buttons 331 to 338 of the stamp selection screen 330 displayed on the display unit 161. The stamp image associated with the instructed selection button is selected as an additional image. The process waits until an additional image is selected (NO in step S04), and if an additional image is selected (YES in step S04), the process proceeds to step S05. When a print instruction is received when the additional image is not selected, the image of the processing target data may be formed.

  In step S05, the size of the additional image is determined to be a predetermined size. The size of the additional image is determined to be a predetermined size for the additional image. In the next step S06, the additional image is superimposed and displayed on preview screen 300 displayed on display portion 161, and the process proceeds to step S07. The position in the preview screen 300 for displaying the additional image is not particularly determined, but may be displayed overlapping the preview area 301.

  In step S07, a blank area in the preview image is determined. The blank area is a rectangular area in which the image is not represented in the preview image. An area where an image is not represented in the preview image can be detected as a set of pixels whose value becomes “0” by binarizing the preview image.

  In the next step S08, it is determined whether the additional image is a default image. If the additional image selected in step S04 is a predetermined default image, the process proceeds to step S09. If not, step S09 is skipped and the process proceeds to step S10. Here, the case where the additional image selected in step S04 is an image of a seal stamp which is a default image will be described as an example. In step S09, a predetermined area corresponding to the additional image is determined, and the process proceeds to step S10. Specifically, the preview image is character-recognized, and a character string of "mark", "signature", "sign" or the user's name is extracted from the preview image, and "mark", "signature", "sign" or the user Determine the blank area in the vicinity of the name string as the default area.

  In step S10, it is determined whether the first operation has been accepted. If the first operation is accepted, the process proceeds to step S18; otherwise, the process proceeds to step S11. The first operation is an operation of continuously instructing an additional image for a predetermined time. When the coordinates in the additional image are continuously output from the touch panel 165 for a predetermined time, the first operation is detected. In step S11, it is determined whether a print instruction has been accepted. If a print instruction is accepted, the process proceeds to step S12; otherwise, the process proceeds to step S14. When the button to which the print instruction is assigned is supported, the print instruction is accepted. For example, when the start key 171 of the hard key unit 167 is pressed, a print instruction is accepted. In step S12, a composite image is generated by combining the preview image and the additional image, and the process proceeds to step S13. In step S13, the image forming unit 140 is controlled to form a composite image on a sheet, and the process ends.

  In step S14, it is determined whether an operation for enlarging or reducing the preview image has been accepted. If an operation to enlarge or reduce the preview image is accepted, the process proceeds to step S15. If not, the process proceeds to step S16. In step S15, the preview image is scaled, and the process returns to step S10. In this case, the additional image is scaled at the same magnification as the scaling of the preview image.

  In step S16, it is determined whether specification of the size of the additional image has been accepted. If the designation of the size is accepted, the process proceeds to step S17. If not, the process returns to step S10. When the pop-up button 305 of the preview screen 300 is instructed and the stamp setting screen 350 is displayed on the display unit 161, the size setting buttons 353 to 353 are selected in response to any of the size setting buttons 353 to 355 being instructed. The specification of the size corresponding to the size setting button instructed in 355 is accepted. In step S17, the size of the additional image is changed to the size specified in step S16, and the process returns to step S10.

  In step S18, the movable state is set, and the process proceeds to step S19. In step S19, the process of moving is executed, and the process proceeds to step S20. The details of the process during movement will be described later, but is a process that is executed while being set in the movable state. In step S20, the movable state is released, and the process returns to step S10.

  FIG. 15 is a flowchart showing an example of the process of movement. The moving process is a process executed in step S19 of FIG. Referring to FIG. 15, CPU 111 determines whether the additional image is a default image (step S21). If the additional image is a default image, the process proceeds to step S22. If not, step S22 is skipped and the process proceeds to step S23. In step S22, an image of a frame of a blank area larger than the additional image is displayed superimposed on the preview image, and the process proceeds to step S23. Thereby, the user can be notified of the area where the additional image can be arranged.

  In step S23, it is determined whether a move operation has been produced. The movement operation is an operation for moving the display unit 161 without releasing a finger or a stylus pen in a state where the user designates an additional image. The coordinates are continuously input from the touch panel 165, and when the values of the coordinates change, the moving operation is produced. If the move operation is detected, the process proceeds to step S24. If not, the process proceeds to step S25. In step S24, a display process during movement is executed, and the process returns to step S23.

  FIG. 16 is a flowchart showing an example of the flow of the display processing during movement. The moving display process is a process executed in step S24 of FIG. Referring to FIG. 16, CPU 111 moves the additional image in accordance with the moving operation (step S41), and advances the process to step S42.

  In step S42, it is determined whether the additional image is a default image. If the additional image is a default image, the process proceeds to step S43; otherwise, the process proceeds to step S46. In step S43, the distance between the additional image and the predetermined area is calculated, and the process proceeds to step S44. In step S44, the size of the additional image is determined. The size is determined based on the size of the additional image, the size of the predetermined area, and the distance calculated in step S43. The size of the additional image specified by the user is assumed to be the initial size, the size that is smaller than the size of the predetermined area is assumed to be the size after movement, the initial size is assigned to the distance before movement, Assign a size, and determine the size proportional to or inversely proportional to the calculated distance. In step S45, the size of the additional image is changed to the determined size, and the process returns to the moving process. As a result, the size of the additional image is changed to fit within the predetermined area as the additional image approaches the predetermined area.

  In step S46, the moving direction of the additional image is determined. The moving direction is determined from two coordinates which the touch panel 165 outputs at different times. In the next step S47, one candidate area is determined from among the one or more blank areas determined in step S07 of the image editing process. Among the one or more blank areas, blank areas existing in the moving direction determined in step S46 from the position of the additional image are determined as candidate areas. When a plurality of blank areas are located in the movement direction from the position of the additional image, the blank area having the shortest distance to the additional image may be determined as the candidate area.

  In the next step S48, the distance between the additional image and the candidate area is calculated, and the process proceeds to step S49. In step S49, the size of the additional image is determined. The size is determined based on the size of the additional image, the size of the candidate area, and the distance calculated in step S47. The size of the additional image specified by the user is assumed to be the initial size, and the size which is smaller than the size of the candidate area is assumed to be the size after movement, and the initial size is assigned to the distance before movement, Assign a size, and determine the size proportional to or inversely proportional to the calculated distance. In step S50, the size of the additional image is changed to the determined size, and the process returns to the moving process. As a result, the size of the additional image is changed to a size that fits in the candidate area as the additional image approaches the candidate area. In Step S22 of the process during movement, an image of a frame of a blank area larger than the size of the additional image is displayed, but the blank area determined as the candidate area in Step S47 is smaller than the size of the additional image It may be a blank area of

  Referring back to FIG. 15, in step S25, it is determined whether the second operation has been detected. The second operation is an operation in which the user releases the finger or the stylus pen from the display surface. In response to the fact that the coordinates input from the touch panel 165 are not input, the second operation is determined. If the second operation is detected, the process proceeds to step S26; otherwise, the process returns to step S23.

  In step S26, an extension time determination process is performed, and the process proceeds to step S27. Although the details of the extension time determination process will be described later, this is a process of determining the extension time. In step S27, it is determined whether the additional image overlaps the prohibited area. The prohibited area includes a rectangular area in which the image to be arranged in the preview image is represented. The rectangular area representing the image to be arranged in the preview image is, for example, a rectangular area surrounding a set of pixels whose value is “1” by binarizing the preview image. In addition, the prohibited area includes an area in the preview image where the image forming unit 140 can not print. If at least part of the additional image overlaps at least part of the prohibited area, it is determined that both overlap. If it is determined that the two overlap, the process proceeds to step S28. If not, the process proceeds to step S33.

  In step S33, it is determined whether the extension time determined in step S28 has passed since the second operation was detected. If the extension time has elapsed, the process returns to the image editing process, but if not, the process proceeds to step S34. In step S34, it is determined whether a move operation has been detected. The movement operation here is an operation for moving the finger or the stylus pen on the display surface of the display unit 161 while the user designates the additional image with the finger or the stylus pen. After the coordinates in the additional image are input from the touch panel 165, the movement operation is detected when the coordinates are continuously input. If the move operation is detected, the process proceeds to step S24. If not, the process returns to step S33. If the moving operation is received before the extension time has elapsed since the second operation was detected, the additional image is moved. Therefore, after the second operation is input, the movable state is maintained only for the extension time, so the user inputs the moving operation without inputting the first operation for setting the movable state. Operation is easy because it is possible to

  In step S28, it is determined whether the additional image overlaps the image in the prohibited area. It is determined whether the additional image overlaps the rectangular area in which the image arranged in the preview image is represented among the prohibited areas. If the additional image overlaps the image in the prohibited area, the process proceeds to step S29. If not, the process returns to step S23. In step S29, it is determined whether overlap with the image is permitted for the additional image. If overlap with the image is permitted for the additional image, the process proceeds to step S30; otherwise, the process returns to step S23.

  In step S30, the candidate image corresponding to the additional image is displayed superimposed on the preview screen. The candidate image is an image that has the same shape as the additional image and is different in color. The color of the candidate image is a color close to or complementary to the color of the color at the position where the additional image overlaps in the preview image. In the next step S31, the process stands by until a candidate image is selected (NO in step S31), and when the candidate image is selected by the user (YES in step S31), the process proceeds to step S32. In step S32, the color of the additional image is changed to the color of the candidate image, and the process returns to the image editing process.

  FIG. 17 is a flowchart illustrating an example of the flow of the extension time determination process. The extension time determination process is a process executed in step S26 of the moving process. Referring to FIG. 17, CPU 111 determines a designated area (step S61). The designated area is an area where the user's finger or stylus pen touches the display surface of the display unit 161. The designated area is determined based on the set of coordinates simultaneously output by the touch panel 165. In the next step S62, it is determined whether the ratio of the designated area to the area of the additional image is equal to or more than a threshold T. If the ratio of the designated area to the area of the additional image is equal to or larger than threshold value T, the process proceeds to step S63; otherwise, the process proceeds to step S64. In step S63, the extension time is determined to be the second time, and the process is returned to the moving process.

  In step S64, the extension time is determined to be the first time, and the process proceeds to step S65. In step S65, it is determined whether the preview image is enlarged. If the preview image is enlarged, the process proceeds to step S66. If not, step S66 is skipped and the process is returned to the moving process. In step S66, the extension time is determined to be the second time, and the process is returned to the process during movement.

  The second time is longer than the first time. The user inputs a moving operation for moving the additional image while touching the display surface of the display unit 161 with a finger or a stylus, but if the ratio of the indicated area to the area of the additional image is equal to or larger than the threshold T, A part of the additional image may be hidden by the user's finger or Utyras pen, and the position of the additional image may not be accurately determined while inputting the moving operation. Therefore, by maintaining the movable state only for the extension time of the second period, the movement operation can be input immediately without inputting the first operation, which facilitates the operation. Further, by setting the second period to be longer than the first period, the period from when the second operation is input until when the next move operation is input becomes longer. It is possible to secure time to confirm the position in the preview image of the additional image.

  In addition, when the preview image is enlarged, it is possible to accurately determine the position of the additional image in the preview image. Therefore, in order to correct the position of the additional image, the moving operation can be input immediately without inputting the first operation, which facilitates the operation. Furthermore, by securing the second period as a period for confirming the position of the additional image, it is possible to ensure time for confirming the position in the preview image of the additional image after the end of the moving operation.

  In the case where the additional image does not overlap with the prohibited area, the movable state is maintained only for the first period or the extension period of the second period, but the first period is set to “0”. It is also good. In this case, when the ratio of the designated area to the area of the additional image is equal to or larger than the threshold T, or when the preview image is displayed in an enlarged scale, the movable state is maintained for the extended period of the second period. Do. Therefore, when the ratio of the designated area to the area of the additional image is equal to or less than the threshold value T and the preview image is not displayed enlarged, the movable state is canceled when the second operation is input. Be done. In this case, after the user inputs the second operation, the user can immediately input an operation different from the move operation.

  Although MFP 100 has been described as an example of a data device in the above-described embodiment, MFP 100 is controlled by the setting method for causing MFP 100 to execute the image editing process shown in FIGS. It goes without saying that the invention can be specified as an image editing program to be executed by the CPU 111.

  It should be understood that the embodiments disclosed herein are illustrative and non-restrictive in every respect. The scope of the present invention is indicated not by the above description but by the claims, and is intended to include all the modifications within the meaning and scope equivalent to the claims.

<Supplementary Note>
(1) The auxiliary means changes the size of the additional image displayed by the display means during movement to a size proportional to the distance from the position detected by the position detection means to the candidate area. 10. The image editing apparatus according to 10.
<Drag and drop>
(2) The operation determining means determines the first operation in response to the position detecting means detecting a position in the additional image for a predetermined time period.
The image editing apparatus according to any one of claims 1 to 12, wherein in the movable state, the second operation is determined according to the fact that the position detection unit no longer detects the position.
<Tap>
(3) The operation determining means determines the first operation in response to the position detection means detecting a position in the additional image in a state in which the movable state is not set.
The image editing apparatus according to any one of claims 1 to 12, wherein the second operation is determined in response to the position detection unit detecting a position in the preview image in the movable state.

100 MFP 110 main circuit 111 CPU 112 communication I / F unit 113 ROM 114 RAM 115 HDD 116 facsimile unit 117 external storage device 118 CD-ROM 120 automatic document feeder 130 document reading unit , 140 image forming unit, 150 sheet feeding unit, 160 operation panel, 161 display unit, 163 operation unit, 165 touch panel, 167 hard key unit, 31 operation determining unit, 33 display control unit, 35 movable state setting unit, 37 release Part, 39 determination part, 41 auxiliary part, 43 movement direction determination part, 45 designated area determination part, 47 blank area determination part, 49 candidate area determination part, 51 default area detection part, 53 preview image display part, 55 additional image display Part, 57 Additional image moving part, 61 Candidate image display part, 63 Release prohibition part, 65 Release extension part, 6 Contour image display unit, 69 resizing section, 71 the composite image generating unit, 73 image forming control unit.

Claims (16)

Display means capable of displaying an image;
Position detection means for detecting a position designated by the user on the display surface of the display means;
Operation determining means for determining an operation by the user based on the detected position;
Preview image display means for displaying an image of data as a preview image on the display means;
Additional image display means for displaying an additional image to be combined with the image of the data on the display means;
In response to the first operation is determined, and the movable state setting means for setting the additional image on a movable state movable in the display surface,
The additional image is detected by the position detection means when the second operation on the display surface is determined in response to the second operation being determined while the movable state is set. Additional image moving means for moving to the specified position;
Auxiliary means for assisting the user's operation based on the additional image and the image arranged in the preview image while in the movable state;
And releasing means for releasing the movable state after the second operation is determined ,
When the additional image after being moved by the additional image moving means and the overlap prohibited area in the preview image do not overlap, the auxiliary means performs the predetermined time after the second operation is determined. An image editing apparatus , comprising release extension means for inhibiting release of the movable state by release means . Display means capable of displaying an image;
Position detection means for detecting a position designated by the user on the display surface of the display means;
Operation determining means for determining an operation by the user based on the detected position;
Preview image display means for displaying an image of data as a preview image on the display means;
Additional image display means for displaying an additional image to be combined with the image of the data on the display means;
In response to the first operation is determined, and the movable state setting means for setting the additional image on a movable state movable in the display surface,
The additional image is detected by the position detection means when the second operation on the display surface is determined in response to the second operation being determined while the movable state is set. Additional image moving means for moving to the specified position;
Auxiliary means for assisting the user's operation based on the additional image and the image arranged in the preview image while in the movable state;
Movement direction determination means for determining the movement direction based on two or more positions detected at different times by the position detection means during the movable state;
A blank area in the preview image, the blank area being disposed in the moving direction determined from the position detected by the position detecting means and having the shortest distance from the position detected by the position detecting means Bei example a candidate region determination means for determining a candidate region, and
The additional image moving means detects the position every time the position is detected by the position detecting means when the position is continuously detected by the position detecting means while being set in the movable state. Placing the additional image on the display means and displaying it on the display means,
The auxiliary means, the size of the additional image displayed on the display means is changed based on the size of the determined candidate region, images editing apparatus. It further comprises releasing means for releasing the movable state after the second operation is determined,
When the additional image after being moved by the additional image moving means and the overlap prohibited area in the preview image do not overlap, the auxiliary means performs the predetermined time after the second operation is determined. It includes a release extension means to prohibit the release of the movable state by releasing means, an image editing apparatus according to claim 2. Before SL auxiliary means, the additional image when the movement and the additional image after being moved by the means and the overlapping forbidden area in the preview image overlap release inhibiting means to prohibit the release of the movable state by the releasing means including, an image editing apparatus according to claim 1 or 3. The release extension means, when the preview image is enlarged, a longer predetermined time, the image editing apparatus according to any one of claims 1, 3 and 4. The apparatus further comprises indicated area determination means for determining an indicated area of the indicated area based on a plurality of positions detected at one time by the position detection means.
The release extension means, based on the instruction area and the area of the additional image is the determined, to determine the predetermined time, the image editing apparatus according to any one of claims 1, 3 to 5. The image editing apparatus according to any one of claims 1 to 6 , wherein the overlap prohibition area includes an area other than the blank area in the preview image. It said preview image display means, when said data includes a plurality of pages, and displays one of the images of the plurality of pages on the display surface of the display unit as the preview image,
The image editing apparatus according to claim 7 , wherein the non-overlapping area includes an area other than the common blank area which is blank in all of the plurality of pages. The preview image display means displays the preview image before an image of the data is formed on the recording medium by an image forming apparatus capable of forming an image on the recording medium.
The overlapping forbidden area includes a non-printable area imaging is not possible due to the image forming apparatus, an image editing apparatus according to any one of claims 1,3～8. The auxiliary means, while in the movable state, displays an outline image which is a blank area in the preview image and which shows an arrangeable area larger than the size of the additional image, superimposed on the preview image and displayed. The image editing apparatus according to any one of claims 1 to 9 , further comprising display means. It further comprises a predetermined area detection means for detecting a predetermined area which is predetermined for arranging the additional image in the preview image,
The image editing apparatus according to claim 1, wherein the auxiliary means changes the size of the additional image based on the size of the additional image and the size of the predetermined area. When the additional image and the image in the preview image overlap, the auxiliary means can select a candidate image of the complementary color of the image having the same shape as the additional image and overlapping with the additional image or a similar color thereof The image editing apparatus according to any one of claims 1 to 11 , further comprising candidate image display means for displaying. An image editing method performed by an image editing apparatus, comprising:
The image editing apparatus
Display means capable of displaying an image;
And position detection means for detecting a position designated by the user on the display surface of the display means.
An operation determining step of determining an operation by the user based on the position detected by the position detecting means;
A preview image display step of displaying an image of data as a preview image on the display means;
An additional image display step of displaying on the display means an additional image to be combined with the image of the data;
In response to the first operation is determined, and the movable state setting step of setting the additional image on a movable state movable in the display surface,
The additional image is detected by the position detection means when the second operation on the display surface is determined in response to the second operation being determined while the movable state is set. An additional image moving step of moving to the specified position;
An auxiliary step of assisting operation by a user based on the additional image and an image arranged in the preview image while in the movable state;
Releasing the movable state after the second operation has been determined;
In the auxiliary step, when the additional image after being moved in the additional image moving step and the overlap prohibited area in the preview image do not overlap, the auxiliary step is performed for a predetermined time after the second operation is determined. An image editing method including a release extension step of prohibiting release of the movable state in the release step . An image editing method performed by an image editing apparatus, comprising:
The image editing apparatus
Display means capable of displaying an image;
And position detection means for detecting a position designated by the user on the display surface of the display means.
An operation determining step of determining an operation by the user based on the detected position;
A preview image display step of displaying an image of data as a preview image on the display means;
An additional image display step of displaying on the display means an additional image to be combined with the image of the data;
A movable state setting step of setting the additional image to be movable in the display surface in response to the determination of the first operation;
The additional image is detected by the position detection means when the second operation on the display surface is determined in response to the second operation being determined while the movable state is set. An additional image moving step of moving to the specified position;
An auxiliary step of assisting operation by a user based on the additional image and an image arranged in the preview image while in the movable state;
A movement direction determination step of determining a movement direction based on two or more positions detected at different times by the position detection means during the movable state;
A blank area in the preview image, the blank area being disposed in the moving direction determined from the position detected by the position detecting means and having the shortest distance from the position detected by the position detecting means Determining a candidate area as a candidate area;
In the additional image moving step, when the position is continuously detected by the position detector while the movable state is set, the position detected by the position detector is detected every time the position is detected. Placing the additional image on the display unit and displaying it on the display means,
The image editing method, wherein the assisting step includes the step of changing the size of the additional image displayed on the display means based on the size of the determined candidate area. An image editing program executed by a computer that controls an image editing apparatus, comprising:
The image editing apparatus
Display means capable of displaying an image;
And position detection means for detecting a position designated by the user on the display surface of the display means.
An operation determining step of determining an operation by the user based on the position detected by the position detecting means;
A preview image display step of displaying an image of data as a preview image on the display means;
An additional image display step of displaying on the display means an additional image to be combined with the image of the data;
In response to the first operation is determined, and the movable state setting step of setting the additional image on a movable state movable in the display surface,
The additional image is detected by the position detection means when the second operation on the display surface is determined in response to the second operation being determined while the movable state is set. An additional image moving step of moving to the specified position;
An auxiliary step of assisting operation by a user based on the additional image and an image arranged in the preview image while in the movable state;
Releasing the movable state after the second operation is determined, causing the computer to execute
In the auxiliary step, when the additional image after being moved in the additional image moving step and the overlap prohibited area in the preview image do not overlap, the auxiliary step is performed for a predetermined time after the second operation is determined. An image editing program comprising a release extension step of prohibiting release of the movable state in the release step . An image editing program executed by a computer that controls an image editing apparatus, comprising:
The image editing apparatus
Display means capable of displaying an image;
And position detection means for detecting a position designated by the user on the display surface of the display means.
An operation determining step of determining an operation by the user based on the detected position;
A preview image display step of displaying an image of data as a preview image on the display means;
An additional image display step of displaying on the display means an additional image to be combined with the image of the data;
A movable state setting step of setting the additional image to be movable in the display surface in response to the determination of the first operation;
The additional image is detected by the position detection means when the second operation on the display surface is determined in response to the second operation being determined while the movable state is set. An additional image moving step of moving to the specified position;
An auxiliary step of assisting operation by a user based on the additional image and an image arranged in the preview image while in the movable state;
A movement direction determination step of determining a movement direction based on two or more positions detected at different times by the position detection means during the movable state;
A blank area in the preview image, the blank area being disposed in the moving direction determined from the position detected by the position detecting means and having the shortest distance from the position detected by the position detecting means Determining the candidate area as the candidate area;
In the additional image moving step, when the position is continuously detected by the position detector while the movable state is set, the position detected by the position detector is detected every time the position is detected. Placing the additional image on the display unit and displaying it on the display means,
The image editing program, wherein the auxiliary step includes the step of changing the size of the additional image displayed on the display means based on the size of the determined candidate area.

Images