JP6930181B2 - Program and information processing terminal - Google Patents

Description

The present invention relates to a program of an information processing terminal that edits an image printed on a print medium.

For example, Patent Document 1 discloses a program of an information processing terminal that edits an image printed on a communication surface of a postcard (hereinafter, referred to as "communication surface image"). More specifically, the program described in Patent Document 1 causes a user to select one of a plurality of template images, edits the selected template image according to a user's instruction, and generates and generates a communication surface image. Have the printer execute a printing operation that records the image of the communication surface on the communication surface of the template.

Further, in recent years, as described in Patent Document 2, for example, a technique of printing a QR code (registered trademark) indicating a URL for accessing information on the Internet on a printing medium has become widespread. Then, by reading the QR code printed on the print medium with the camera of the mobile terminal and extracting the URL from the read QR code, the information on the Internet indicated by the URL can be accessed.

Japanese Unexamined Patent Publication No. 2016-081299 Japanese Unexamined Patent Publication No. 2011-078071

The QR code is a rectangular image including a plurality of bright cells which are white quadrangles, a plurality of dark cells which are black quadrangles, and position detection images arranged at three corners. That is, the QR code is not an image in which the user can understand the meaning and content at first glance, but an image in which the URL can be extracted by image processing with a predetermined algorithm. Therefore, for example, when a QR code is combined with a template image to generate a communication surface image, there arises a problem that the design arranged on the communication surface image becomes difficult to see.

The present invention has been made in view of the above circumstances, and an object of the present invention is information capable of synthesizing an information holding image on a communication surface image printed on a print medium in a manner that reduces the difficulty of seeing a pattern. The purpose is to provide a program for a processing terminal.

Various disclosures are made herein. The program, which is one of the disclosure examples, can be executed by an information processing terminal including an input interface and a communication interface. The program combines a first reception process for receiving a user operation for designating a plurality of images through the input interface and a plurality of images specified in the first reception process, and prints a print image printed on a print medium. The information processing terminal is made to execute the generation process of generating the above and the print instruction process of transmitting the print instruction information to the printer through the communication interface. The print instruction information is information for printing the print image generated in the generation process on a print medium. A part of the plurality of images designated in the first reception process is an information holding image. The information-retaining image includes a plurality of bright cells, a plurality of dark cells having a brightness lower than that of the bright cells, and a position detection image arranged at a predetermined position in the information-retaining image, and is stored in a server. Address information indicating the address of the stored data is held as a combination of the bright cell and the dark cell. The program overlaps with the information-retaining image and is behind the information-retaining image in the overlapping direction in the generation process when the bright cell of the information-retaining image specified in the first reception process is a transparent color. The information-retaining image is rotated and combined in a direction corresponding to the positional relationship with another image located in.

When the bright cell of the information holding image is set to a transparent color, the pattern located at the back of the position detection image tends to be difficult to see. Therefore, according to the above configuration, by rotating the information holding image in a direction corresponding to the positional relationship with other images located in the back of the information holding image, it is possible to reduce the difficulty of seeing the pattern overlapping with the information holding image. Can be done.

FIG. 1 is a block diagram of the printing system 100 according to the embodiment. FIG. 2 is a diagram showing an example of a URL list stored in the memory 62. FIG. 3 is a flowchart of the communication surface editing process. FIG. 4 is a flowchart of the stamp composition process. FIG. 5 is a flowchart of the stamp moving process A. FIG. 6 is a flowchart of the stamp moving process B. 7A and 7B are display examples of the display 53, in which FIG. 7A shows a template selection screen and FIG. 7B shows a template editing screen. 8A and 8B are display examples of the display 53, in which FIG. 8A shows a stamp selection screen 130 and FIG. 8B shows a URL selection screen 140. 9A and 9B are display examples of the display 53, in which FIG. 9A shows an issue confirmation screen 150 and FIG. 9B shows a ground color selection screen 160. 10A and 10B are display examples of the display 53, in which FIG. 10A is a stamp editing screen including a template image 121 in which a QR stamp 173 is combined, and FIG. 10B is a template in which a QR stamp 173 and a symbol stamp 174 are combined. The stamp editing screen including the image 121 is shown. 11A and 11B are views showing the relationship between the position and orientation of the QR stamp 173 on the template image 121. FIG. 11A shows a state in which the QR stamp 173 is arranged in the upper left region, and FIG. 11B shows the QR stamp 173 in the upper left region. (C) indicates a state in which the QR stamp 173 is arranged in the lower left area, and (D) indicates a state in which the QR stamp 173 is arranged in the lower right area. FIG. 12 is a diagram showing the relationship between the overlap and orientation of the QR stamp 173 with respect to the symbol stamp 174. FIG. 12A shows a state in which the lower right corner of the QR stamp 173 overlaps the symbol stamp 174, and FIG. 12B shows the QR stamp. The lower left corner of 173 overlaps the symbol stamp 174, (C) the upper right corner of the QR stamp 173 overlaps the symbol stamp 174, and (D) the upper left corner of the QR stamp 173 overlaps the symbol stamp 174. show.

Hereinafter, embodiments of the present invention will be described with reference to the drawings as appropriate. It goes without saying that the embodiments described below are merely examples of the present invention, and the embodiments of the present invention can be appropriately changed without changing the gist of the present invention.

FIG. 1 is a schematic view of a printing system 100 according to the present embodiment. The printing system 100 shown in FIG. 1 includes an MFP (abbreviation of Multi-Function Peripheral) 10 and an information processing terminal 50. Further, the printing system 100 may include a printer single-purpose machine instead of the MFP 10.

The MFP 10 and the information processing terminal 50 are configured to be able to communicate with each other through the communication network 101. Specific examples of the communication network 101 are not particularly limited, but may be, for example, the Internet, a wired LAN, a wireless LAN, or a combination thereof. Alternatively, the MFP 10 and the information processing terminal 50 may be connected by a USB cable or the like. Further, the information processing terminal 50 can communicate with the server 80 on the Internet.

As shown in FIG. 1, the MFP 10 mainly includes a printer 11, a scanner 12, a display 23, an input I / F 24, a communication I / F 25, a CPU 31, a memory 32, and a communication bus 33. .. The components constituting the MFP 10 are connected to each other through the communication bus 33.

The printer 11 executes a printing operation of printing an image indicated by image data on a sheet. As the printing technique of the printer 11, known techniques such as an inkjet technique and an electrophotographic technique can be adopted. The scanner 12 executes a scanning operation of reading an image printed on a document and generating image data. However, the scanner 12 can be omitted.

The display 23 is a liquid crystal display, an organic EL display, or the like, and includes a display screen for displaying various information.

The input I / F 24 is a user interface that accepts input operations by the user. Specifically, the input I / F 24 has a button, and outputs various operation signals associated with the pressed button to the CPU 31. Further, the input I / F 24 may have a film-like touch sensor superimposed on the display surface of the display 23. The operation of designating an object displayed on the display surface of the display 23 and the operation of inputting a character string or a number string are examples of user operations. The “object” is, for example, a character string, an icon, a button, a link, a radio button, a check box, a pull-down menu, or the like displayed on the display 23.

The input I / F24 realized as a touch sensor outputs position information indicating a position on the display surface touched by the user. The term "touch" in the present specification includes all operations of bringing the input medium into contact with the display surface. Further, even if the input medium does not touch the display surface, the "hover" or "floating touch" that brings the input medium close to the position where the distance from the display surface is very small is adopted as the above-mentioned concept of "touch". May be included. Further, the input medium may be a user's finger, a touch pen, or the like. The user operation of tapping the position of the object displayed on the display 23 is an example of the user operation of designating the object.

The communication I / F 25 is an interface capable of communicating with an external device through the communication network 101. That is, the MFP 10 transmits various information to the external device through the communication I / F25, and receives various information from the external device through the communication I / F25. The specific communication procedure of the communication I / F 25 is not particularly limited, but for example, Wi-Fi (registered trademark) can be adopted. When the MFP 10 and the information processing terminal 50 are connected by a USB cable, the communication I / F 25 may be a USB interface to which the USB cable can be attached and detached.

The CPU 31 controls the overall operation of the MFP 10. The CPU 31 acquires various programs to be described later from the memory 32 and executes them based on various information output from the input I / F 24, various information received from the external device through the communication I / F 25, and the like. The CPU 31 and the memory 32 form an example of the controller.

The memory 32 stores the OS 34 and the device program 35. The device program 35 may be a single program or a collection of a plurality of programs. Further, the memory 32 stores data or information necessary for executing the device program 35. The memory 32 is composed of, for example, a RAM, a ROM, an EEPROM, an HDD, a portable storage medium such as a USB memory attached to and detached from the MFP 10, a buffer included in the CPU 31, or a combination thereof.

The memory 32 may be a computer-readable storage medium. A computer-readable storage medium is a non-transitory medium. In addition to the above examples, the non-transitory medium also includes a recording medium such as a CD-ROM or a DVD-ROM. The non-transitory medium is also a tangible medium. On the other hand, an electric signal that carries a program downloaded from a server on the Internet is a computer-readable signal medium, which is a kind of computer-readable medium, but is a storage that can be read by a non-transitory computer. Not included in the medium. The same applies to the memory 62 of the information processing terminal 50, which will be described later.

As shown in FIG. 1, the information processing terminal 50 mainly includes a display 53, an input I / F 54, a communication I / F 55, a CPU 61, a memory 62, and a communication bus 63. The display 53, the input I / F 54, the communication I / F 55, the CPU 61, the memory 62, and the communication bus 63 included in the information processing terminal 50 are the display 23, the input I / F 24, the communication I / F 25, the CPU 31, and the communication bus 63 included in the MFP 10. Since the configuration is the same as that of the memory 32 and the communication bus 33, the description thereof will be omitted. The CPU 61 and the memory 62 are examples of the controller.

The information processing terminal 50 is, for example, a mobile phone, a smartphone, a tablet terminal, a PC, or the like. More specifically, the display 53 of the information processing terminal 50 preferably has a display screen size of 12 inches or less, more preferably 8 inches or less. Further, it is desirable that the input I / F 54 of the information processing terminal 50 is a touch panel superimposed on the display screen of the display 53.

The memory 62 stores the OS 64. The OS 64 may be, for example, Windows (registered trademark) Operating System, Android (registered trademark) OS, iOS (registered trademark), or the like. The OS 64 can execute a plurality of programs installed in the information processing terminal 50 in parallel. A plurality of programs are virtually executed in parallel by a time division multiplexing method, for example. Further, the OS 64 executes one of a plurality of programs executed in parallel in the foreground, and executes the other programs in the background. The foreground is, for example, a state in which the screen generated by the program is displayed on the display 53. The background is, for example, a state in which the screen generated by the program is not displayed on the display 53.

Further, the memory 62 stores the postcard program 65 and the URL management program 66. The postcard program 65 is a program that causes the MFP 10 to perform a printing operation of generating an image to be recorded on the address side and the communication side of the postcard according to a user's instruction and printing the generated image on the postcard. The URL management program 66 is an example of an external program that uploads content data to a server 80 on the Internet and manages address information indicating an address of the content data stored in the server 80. The content data refers to, for example, image data, photo data, moving image data, HTML data, and the like. The address information is, for example, URL-formatted information.

The memory 62 can store the URL list shown in FIG. The URL list contains one or more URL records. The URL record includes name information and a URL. The URL management program 66 registers a URL record including the URL of the content data and the name information input by the user through the input I / F 54 in the URL list in response to the upload of the content data to the server 80. ..

Further, the memory 62 can store template image data (not shown). The template image data indicates a template image printed on the communication surface of the postcard. The template image is a rectangular image that substantially matches the size of the postcard. In this embodiment, an example of a template image printed on the communication surface of a New Year's card will be described, but the use of the template image is not limited to this, and can be applied to, for example, summer greeting cards, Christmas cards, and the like. Postcards and Christmas cards are examples of print media. However, specific examples of print media are not limited to these, and any envelope, leaflet, or any other material capable of printing an image is applicable.

Further, the memory 62 can store symbol stamp data (not shown). The symbol stamp data is image data indicating a symbol stamp which is an example of a symbol image. The design stamp is, for example, an image showing a zodiac sign, a pictogram, or the like. In addition to the design stamp, the stamp includes a QR stamp which is an example of an information holding image. The symbol stamp and the QR stamp (these may be collectively referred to as "stamp") are images that can be combined on the template image, and the image size is smaller than that of the template image.

The symbol stamp is an image showing a symbol whose meaning and content can be visually recognized. On the other hand, the QR stamp is an image representing a QR code (registered trademark), and it is extremely difficult to visually recognize the meaning and content. The QR stamp is an image that holds address information indicating the address of the content data stored in the server 80. More specifically, the QR stamp is an image that retains information that can be extracted by image processing by a program after being optically read by a camera or the like. The specific example of the information holding image is not limited to the QR code, and may be Data Matrix or the like. In other words, the information holding image may be an image representing a so-called two-dimensional bar code.

For example, as shown in FIG. 10A, the QR stamp 173 is a rectangular (typically a square) image composed of a plurality of bright cells and a plurality of dark cells. A bright cell is a quadrangle with a higher brightness than a dark cell. The color of the bright cell is, for example, white or transparent. A dark cell is a quadrangle with a lower brightness than a light cell. The color of the bright cell is, for example, black. The transparent color refers to a color in which the design of the template image 121 can be visually recognized through a bright cell when the QR stamp 173 is combined with the template image 121, for example, as shown in FIG. On the other hand, white and black are non-transparent colors. The non-transparent color refers to a color in which the design of the template image 121 cannot be visually recognized through the bright cell.

Then, the QR stamp 173 holds information as a combination of a plurality of bright cells and a plurality of dark cells. That is, the QR stamps that hold different information have different arrangements of bright cells and dark cells. Further, the QR stamp 173 includes a finder pattern. The finder pattern is an example of a position detection image for detecting the position and orientation of the QR code represented by the QR stamp 173. The finder pattern is placed at a predetermined position within the QR stamp 173. More specifically, the finder pattern is arranged at three of the four corners of the rectangular QR stamp 173.

The finder pattern, like the other parts of the QR stamp 173, is composed of a combination of light cells and dark cells. More specifically, the finder pattern has a shape in which a square composed of a plurality of dark cells is surrounded by a first frame composed of a plurality of bright cells and a second frame composed of a plurality of dark cells. be. That is, the finder pattern has the same shape for all QR codes. Further, the density of dark cells in the finder pattern is often higher than the density of dark cells in other parts of the QR stamp 173. That is, when the bright cell is a transparent color in the example of FIG. 10A, the design of the template image 121 is likely to be harder to see at the position of the finder pattern than at other positions.

The server 80 is arranged on the Internet, for example, and functions as a storage server and a WEB server. That is, the server 80 publishes the content data uploaded from the URL management program 66 or the like on the Internet. More specifically, the server 80 stores the content data in the server memory in response to the content data being uploaded from the URL management program 66, and manages the URL indicating the memory area in which the content data is stored. Send to program 66. Further, the server 80 transmits the content data stored in the memory area indicated by the URL to the information processing terminal 50 in response to the URL specified by the information processing terminal 50.

[Operation of printing system 100]
The operation of the printing system 100 according to the present embodiment will be described with reference to FIGS. 3 to 6.

[Communication surface editing process]
First, the postcard program 65 executed in the foreground causes the template selection screen shown in FIG. 7A to be displayed on the display 53 (S11). The template selection screen includes a plurality of template icons 111, 112, 113, 114. The template icons 111 to 114 correspond to one of a plurality of template image data stored in the memory 62. Then, the postcard program 65 accepts the user operation for the template selection screen through the input I / F 54 (S12). The process of S12 is an example of the first reception process.

Next, the postcard program 65 stores the template image data associated with the designated template icon 113 in the memory 62, for example, in response to receiving the designation of the template icon 113 through the input I / F 54 (S12: Yes). Read from. Next, the postcard program 65 causes the template editing screen shown in FIG. 7B to be displayed on the display 53 instead of the template selection screen (S13). Then, the postcard program 65 accepts the user operation on the template edit screen through the input I / F 54 (S14).

The template editing screen includes a template image 121, a font icon 123, a stamp icon 124, a [save] icon 125, and a [print] icon 126. The template image 121 is an image indicated by the read template image data. The font icon 123 corresponds to an instruction to switch the font (for example, Gothic font, Mincho font, etc.) of the characters included in the template image 121. The stamp icon 124 corresponds to an instruction to select a stamp to be combined with the template image 121. The [Save] icon 125 corresponds to an instruction to store the edited template image data in the memory 62. The [Print] icon 126 corresponds to an instruction to print the edited template image 121 on the communication surface of the postcard.

Next, the postcard program 65 executes the stamp composition process in response to the designation of the stamp icon 124 being received through the input I / F 54 (S14: stamp) (S15). The stamp composition process is a process of synthesizing a stamp on the template image 121. The details of the stamp composition process will be described with reference to FIG.

[Stamp composition process]
First, the postcard program 65 displays the stamp selection screen 130 shown in FIG. 8A on the display 53 instead of the template editing screen (S21). The stamp selection screen 130 according to the present embodiment is a pop-up window that is superimposed on the stamp editing screen described later. The stamp selection screen 130 includes a switching tab 131 in the selected state, a switching tab 132 in the non-selected state, and stamp icons 133, 134, 135, and 136. The stamp icons 133 to 136 correspond to one of the stamp data stored in the memory 62. Then, the postcard program 65 accepts the user operation on the stamp selection screen 130 through the input I / F 54 (S22). The process of S22 is an example of the first reception process.

Next, the postcard program 65 acquires the URL list shown in FIG. 2 from the URL management program 66 in response to receiving the designation of the switching tab 132 in the non-selected state through the input I / F 54 (S22: tab). (S23). The postcard program 65 starts the URL management program 66, for example, by using the start API provided by the OS 64 to start the external program. Next, the postcard program 65 acquires a pointer indicating the start address of the memory area for storing the URL list as the return value of the activation API. Then, the postcard program 65 reads the URL list from the memory area indicated by the acquired pointer.

Next, the postcard program 65 causes the URL selection screen 140 shown in FIG. 8B to be displayed on the display 53 instead of the stamp selection screen 130 (S24). The URL selection screen 140 includes a switching tab 131 in a non-selected state, a switching tab 132 in a selected state, and URL icons 141 and 142. The URL icons 141 and 142 correspond to one of the URL records acquired in S23. Further, in the URL icons 141 and 142, character strings indicated by the name information of the corresponding URL records are described. Then, the postcard program 65 accepts the user operation on the URL selection screen 140 through the input I / F 54 (S25). The process of S25 is an example of the first reception process.

Next, the postcard program 65 displays the URL of the stamp selection screen 130 shown in FIG. 8 (A) in response to the reception of the designation of the switching tab 131 in the non-selected state through the input I / F 54 (S25: tab). The display 53 is displayed instead of the selection screen 140 (S21). On the other hand, the postcard program 65 is started to display the issuance confirmation screen 150 shown in FIG. 9 (A) in response to the reception of the designation of the URL icon 141 through the input I / F 54 (S25: URL), for example. The URL management program 66 is started using the API (S26). As a result, the OS 64 executes the postcard program 65 in the background and the URL management program 66 in the foreground.

The URL management program 66 causes the issuance confirmation screen 150 shown in FIG. 9A to be displayed on the display 53 in response to being activated by the postcard program 65. The issuance confirmation screen 150 includes a representative image 151, a message "Do you want to issue a QR code for the" family travel movie "?", An [issue] icon 152, and a [cancel] icon 153. Then, the URL management program 66 accepts the user operation on the issuance confirmation screen 150 through the input I / F 54.

The representative image 151 is an image included in the content data indicated by the URL of the URL record corresponding to the URL icon 141. As an example, when the content data is moving image data, the representative image 151 is an image showing one scene of the moving image data. As another example, when the content data is still image data, the representative image 151 is the still image itself represented by the still image data. The [Issue] icon 152 corresponds to an instruction to issue a QR stamp holding the URL of the URL record corresponding to the URL icon 141. The [Cancel] icon 153 corresponds to an instruction not to issue a QR stamp.

Next, the URL management program 66 receives the designation of the [issue] icon 152 or the [cancel] icon 153 through the input I / F 54, and uses the information indicating the designated icon as the return value of the activation API. Provided to the postcard program 65. As a result, the OS 64 executes the postcard program 65 in the foreground and the URL management program 66 in the background.

Next, the postcard program 65 determines which of the [issue] icon 152 and the [cancel] icon 153 is specified based on the information acquired as the return value of the activation API (S27). Then, the postcard program 65 ends the stamp composition process without executing the processes after S28 in response to the determination that the [Cancel] icon 153 is specified (S27: Cancel).

On the other hand, the postcard program 65 replaces the ground color selection screen 160 shown in FIG. 9 (B) with the issue confirmation screen 150 in response to the determination that the [issue] icon 152 has been specified (S27: issue). It is displayed on the display 53 (S28). The ground color selection screen 160 is a screen for allowing the user to specify the color of the bright cell of the QR stamp to be generated. On the ground color selection screen 160, the message "Please select the color of the bright cell of the QR code", the [white background] icon 161 corresponding to the instruction to make the bright cell non-transparent, and the bright cell transparent. Includes [Transparent] icon 162 and corresponding instructions for coloring. Then, the postcard program 65 accepts the user operation on the ground color selection screen 160 through the input I / F 54 (S29). The process of S29 is an example of the third reception process.

Next, the Hagaki program 65 receives the designation of the [white background] icon 161 through the input I / F54 (S29: white background), and the URL of the URL record corresponding to the URL icon 141 “http: // www. A QR stamp 173 holding "server-a.com/trip.mov" is generated with bright cells as white (S30). On the other hand, the postcard program 65 receives the designation of the [transparent] icon 162 through the input I / F 54 (S29: transparent), and receives the QR stamp 173 that holds the URL of the URL record corresponding to the URL icon 141. A bright cell is generated as a transparent color (S31). That is, the QR stamps 173 generated in S30 and S31 have the same arrangement of the bright cells and the dark cells, and the colors of the bright cells are different. Since the algorithm for generating the QR stamp 173 is already well known, detailed description thereof will be omitted.

Next, the postcard program 65 synthesizes the QR stamp 173 generated in S30 and S31 at the QR initial position of the template image 121 (S32). The QR stamp 173 is arranged on the front side in the overlapping direction (so-called Z direction) from the template image 121. In other words, the template image 121 is arranged behind the QR stamp 173 in the overlapping direction. The QR initial position is a predetermined position as a position for synthesizing the QR stamp 173. The template image 121 in which the QR stamp 173 is combined is an example of a printed image. The process of S32 is an example of the generation process.

As shown in FIG. 11, for example, the template image 121 according to the present embodiment has a virtual line 181 extending from the center in the lateral direction along the longitudinal direction and a virtual line 181 extending from the center in the longitudinal direction along the lateral direction. It is divided into four virtual areas by 182. Then, of the four areas divided by the virtual lines 181 and 182, the upper left area is referred to as "upper left area", the upper right area is referred to as "upper right area", and the lower left area is referred to as "lower left area". Notated, and the lower right area is referred to as the "lower right area". The QR initial position in the present embodiment is the upper left region of the template image 121. Then, in the QR stamp 173 arranged at the QR initial position, as shown in FIGS. 10A and 11A, the corner where the finder pattern is not arranged is the center of the template image 121 (that is, the virtual line). It is combined with the template image 121 in the direction closest to the intersection of 181 and 182).

Next, the postcard program 65 causes the stamp editing screen shown in FIG. 10A to be displayed on the display 53 (S34). The stamp editing screen shown in FIG. 10A includes a template image 121 in which the QR stamp 173 is combined, a [stamp addition] icon 171 and a [decision] icon 172. In the bright cell of QR stamp 173 on the stamp edit screen, for example, the transmittance is set to be less than the threshold value (for example, 0%) when white is specified, and the transmittance is equal to or more than the threshold value when a transparent color is specified. It is set to (for example, 100%). Then, the postcard program 65 accepts the user operation on the stamp editing screen through the input I / F 54 (S35). The process of S35 is an example of the second reception process.

Next, the postcard program 65 executes the stamp movement process in response to the acceptance of the drag operation for the position of the QR stamp 173 through the input I / F 54 (S35: drag) (S36). The drag operation is an operation of touching the input medium at the display position of the QR stamp 173 and moving the input medium on the display surface. The drag operation is an example of a user operation for changing the position of the QR stamp 173 on the template image.

The stamp movement process is a process of moving the QR stamp 173 on the template image 121 according to a drag operation. The stamp movement process is executed not only when the QR stamp 173 but also when the drag operation for the position of the symbol stamp 174, which will be described later, is accepted. The details of the stamp moving process A will be described with reference to FIG.

[Stamp movement process A]
First, the postcard program 65 moves the QR stamp 173 on the template image 121 following the movement of the input medium on the template image 121 (S41). More specifically, the postcard program 65 detects the moving direction and the moving amount of the input medium touched at the position of the QR stamp 173 through the touch sensor. Next, the postcard program 65 moves the QR stamp 173 on the template image 121 by the detected movement amount in the detected movement direction.

Further, the postcard program 65 determines which of the QR stamp 173 and the symbol stamp 174 the drag operation is performed (S42). Further, the postcard program 65 determines the color of the bright cell of the QR stamp 173 (S43) according to the determination that the QR stamp is 173 (S42: QR). Further, in the postcard program 65, in response to the determination that the bright cell of the QR stamp 173 is a transparent color (S43: transparent), the QR stamp 173 moved in S41 is placed in any area on the template image 121. It is determined whether or not (S44 to S47).

As an example, as shown in FIG. 11 (A), the postcard program 65 determines that the QR stamp 173 has been moved from an area different from the upper left area of the template image 121 to the upper left area (S44: Yes). , The QR stamp 173 is rotated so that the corner where the finder pattern is not arranged faces the lower right (S48). As another example, the postcard program 65 is shown in FIG. 11 (B) in response to determining that the QR stamp 173 has been moved from an area different from the upper right area of the template image 121 to the upper right area (S45: Yes). As described above, the QR stamp 173 is rotated so that the corner where the finder pattern is not arranged faces the lower left (S49).

As another example, the postcard program 65 is shown in FIG. 11 (C) in response to determining that the QR stamp 173 has been moved from a region different from the lower left region of the template image 121 to the lower left region (S46: Yes). As described above, the QR stamp 173 is rotated so that the corner where the finder pattern is not arranged faces the upper right (S50). As yet another example, the postcard program 65 determines that the QR stamp 173 has been moved from a region different from the lower right region of the template image 121 to the lower right region (S47: Yes), and FIG. 11 (D). As shown in, the QR stamp 173 is rotated so that the corner where the finder pattern is not arranged faces the upper left (S51).

That is, the postcard program 65 rotates the QR stamp 173 moved in S41 so that the corner where the finder pattern is not arranged faces the center of the template image 121 (S48 to S51). In the postcard program 65, for example, the center of the QR stamp 173 passes through a virtual line that is a boundary between the first region where the QR stamp 173 before the movement is arranged and the second region adjacent to the first region. The QR stamp 173 may be rotated at the same timing. On the other hand, when the QR stamp 173 is moving within the same area, the postcard program 65 does not rotate the QR stamp 173.

The postcard program 65 repeatedly executes the processes S41 to S51 until the drag operation is completed (S52: No). Then, the postcard program 65 synthesizes a stamp at the end position of the drag operation on the template image 121 in response to the input medium being separated from the display 53 (that is, the drag operation is completed) (S52: Yes). Then, the stamp movement process A is finished. On the other hand, the postcard program 65 determines that the drag operation has been performed on the symbol stamp 174 (S42: symbol) or that the bright cell of the QR stamp 173 is white (S43:). White background), without executing the processes of S44 to S51, the process of S41 is repeatedly executed until the drag operation is completed (S52: No).

Next, returning to FIG. 4, the postcard program 65 re-executes the processes after S34. Although not shown, the postcard program 65 re-executes the processes after S21 in response to the acceptance of the designation of the [add stamp] icon 171 on the stamp edit screen. Further, the postcard program 65 ends the stamp composition process in response to receiving the designation of the [decision] icon 172 on the stamp edit screen through the input I / F54 (S35: decision).

Next, returning to FIG. 3, the postcard program 65 switches the font of the character string included in the template image 121 according to the designation of the font icon 123 on the template edit screen through the input I / F 54. Further, the Hagaki program 65 stores the edited template image data in the memory 62 in response to the designation of the [Save] icon 125 on the template editing screen being received through the input I / F 54.

Further, the postcard program 65 transmits print instruction information to the MFP 10 through the communication I / F 55 in response to the designation of the [print] icon 126 on the template edit screen being received through the input I / F 54 (S14: print) (S14: print). S16). The print instruction information is information for causing the MFP 10 to perform a print operation of printing the template image 121 on which the QR stamp 173 is synthesized on the communication surface of the postcard. The print instruction information includes template image data indicating the template image 121 in which the QR stamp 173 is combined. The process of S16 is an example of the print instruction process.

On the other hand, although not shown, the device program 35 of the MFP 10 receives print instruction information from the information processing terminal 50 through the communication I / F 25. Then, the device program 35 causes the printer 11 to execute a printing operation according to the received print instruction information. That is, the printer 11 prints the template image 121 indicated by the template image data included in the print instruction information on the communication surface of the postcard. On the communication surface of the postcard output from the printer 11, the design of the template image 121 located at the back of the bright cell is printed at the position corresponding to the bright cell of the transparent color.

Further, returning to FIG. 4, the postcard program 65 receives, for example, the designation of the stamp icon 133 on the stamp selection screen 130 through the input I / F 54 (S22: stamp), and the stamp data corresponding to the stamp icon 133. Is read from the memory 62. Then, the postcard program 65 synthesizes the symbol stamp 174 indicated by the read stamp data at the initial symbol position of the template image 121 (S33). The initial symbol position is a predetermined position as a position for synthesizing the symbol stamp 174. Further, the initial symbol position may be a position different from the above-mentioned QR initial position. The process of S33 is an example of the generation process.

By repeatedly executing the processes of S21 to S34 by the postcard program 65, for example, as shown in FIG. 10B, the stamp editing screen in which the QR stamp 173 and the symbol stamp 174 are combined with the template image 121 is displayed on the display 53. Is displayed. Since the symbol stamp 174 indicates a symbol that the user visually recognizes, a big problem does not occur even if a part of the stamp is hidden. On the other hand, since the QR stamp 173 is optically read by a camera or the like and then subjected to image processing to extract the URL, the URL cannot be properly extracted if a part of the QR stamp 173 is hidden. Therefore, when a part of the QR stamp 173 and the symbol stamp 174 overlap each other, the QR stamp 173 is arranged on the front side in the overlapping direction with respect to the symbol stamp 174. In other words, the symbol stamp 174 is arranged behind the QR stamp 173 in the overlapping direction.

Then, the postcard program 65 executes the stamp movement process B shown in FIG. 6 in response to the acceptance of the drag operation for the position of the QR stamp 173 in FIG. 10 (B) through the input I / F 54 (S35: drag). (S36). Since S61 to S63 and S72 in FIG. 6 are common to S41 to S43 and S52 in FIG. 5, detailed description of the common points will be omitted, and the differences will be mainly described.

[Stamp movement process B]
As an example, in the postcard program 65, the finder pattern is arranged as shown in FIG. 12 (A) according to the fact that the lower right corner of the QR stamp 173 after movement overlaps the symbol stamp 174 (S64: Yes). Rotate the QR stamp 173 so that the no corners are facing the lower right (S68). As another example, in the postcard program 65, the finder pattern is arranged as shown in FIG. 12 (B) according to the lower left corner of the moved QR stamp 173 overlapping the symbol stamp 174 (S65: Yes). Rotate the QR stamp 173 so that the unmarked corner faces the lower left (S69).

As another example, in the postcard program 65, the finder pattern is arranged as shown in FIG. 12 (C) according to the upper right corner of the moved QR stamp 173 overlapping the symbol stamp 174 (S66: Yes). Rotate the QR stamp 173 so that the unmarked corner faces the upper right (S70). As yet another example, in the postcard program 65, the finder pattern is as shown in FIG. 12 (D) according to the upper left corner of the QR stamp 173 after movement overlapping the symbol stamp 174 (S67: Yes). The QR stamp 173 is rotated so that the unarranged corner faces the upper left (S71).

That is, the postcard program 65 rotates the QR stamp 173 moved in S61 so that the corner of the QR stamp 173 on which the finder pattern is not arranged overlaps the symbol stamp 174 (S68 to S71). On the other hand, in the postcard program 65, the QR stamp 173 may be oriented in a predetermined direction depending on that the QR stamp 173 does not overlap the symbol stamp 174.

[Action and effect of this embodiment]
When the bright cell of the QR stamp 173 is a transparent color, the pattern located at the back of the finder pattern tends to be difficult to see. Therefore, as in the above embodiment, by rotating the QR stamp 173 in a direction corresponding to the positional relationship with the template image 121 or the symbol stamp 174 located at the back of the QR stamp 173, the symbol that overlaps with the QR stamp 173 can be viewed. Difficulty can be reduced.

As an example, the pattern to be emphasized on the template image 121 tends to be arranged in the central portion of the template image 121. Therefore, as in the above embodiment, the QR stamp 173 is rotated and combined so that the corner where the finder pattern is not arranged is closest to the center of the template image 121, so that the pattern to be emphasized on the template image 121 is to be emphasized. It is possible to reduce the difficulty of seeing. As another example, by rotating the QR stamp 173 so that the corner where the finder pattern is not arranged overlaps with the symbol stamp 174, it is possible to reduce the difficulty of seeing the symbol indicated by the symbol stamp 174.

Further, according to the above embodiment, not only when the QR stamp 173 is arranged at the QR initial position but also when the QR stamp 173 is moved to the position desired by the user on the template image 121, after the movement. The QR stamp 173 is rotated in the direction suitable for the position of. As a result, it is possible to further reduce the difficulty of seeing the symbol indicated by the template image 121 or the symbol stamp 174 located at the back of the QR stamp 173.

In the stamp movement process A shown in FIG. 5, the postcard program 65 may further determine whether or not the QR stamp 173 overlaps the outer edge portion of the template image 121. The outer edge portion of the template image 121 is a frame-shaped area that occupies a predetermined width from the contour of the template image 121 toward the center. Then, when the postcard program 65 determines that the QR stamp 173 overlaps the outer edge portion of the template image 121, the processes of S44 to S51 may be executed. On the other hand, the postcard program 65 does not have to execute the processes S44 to S51 when it is determined that the QR stamp 173 does not overlap the outer edge portion of the template image 121.

It is unlikely that a pattern to be emphasized is arranged on the outer edge of the template image 121. Therefore, when the QR stamp 173 overlaps the outer edge portion of the template image 121 as in the above modified example, the QR stamp 173 is rotated so that the finder pattern overlaps the outer edge portion of the template image 121, thereby displaying the QR stamp 173 on the template image 121. It is possible to further reduce the difficulty of seeing the design.

Further, if the bright cell of the QR stamp 173 is made a transparent color, it becomes difficult to distinguish between the bright cell and the dark cell, and there is a possibility that the URL cannot be extracted from the QR stamp 173. Therefore, as in the above embodiment, the bright cell is made transparent in order to make it easier to see the pattern at the position where the QR stamp 173 is overlapped, or the bright cell is not set in order to maintain the extraction accuracy of the URL from the QR stamp 173. It is desirable to let the user choose whether to use a transparent color.

However, the method of determining the color of the bright cell is not limited to the examples of S28 and S29. As another example, the postcard program 65 may determine whether or not the representative value of the lightness of the template image 121 is equal to or greater than the threshold value. The representative value of lightness is the mode value, the average value, the median value, or the like of the lightness of a plurality of pixels constituting the template image 121. This process is an example of a determination process. Then, the postcard program 65 may generate a QR stamp 173 in which the bright cell is a transparent color, depending on the determination that the representative value of the lightness is equal to or higher than the threshold value. On the other hand, the postcard program 65 may generate a QR stamp 173 in which the bright cell is a non-transparent color, depending on the determination that the representative value of the lightness is less than the threshold value.

If the bright cell is made transparent when the brightness of the template image 121 is low, it becomes difficult to distinguish between the bright cell and the dark cell, and there is a possibility that the URL cannot be extracted from the QR stamp 173. Therefore, as in the above modification, by making the bright cell a transparent color only when the representative value of the brightness of the template image 121 is equal to or greater than the threshold value, the accuracy of extracting the URL from the QR stamp 173 can be maintained and the pattern can be viewed. It is possible to achieve both reduction of difficulty.

Further, in the MFP 10 and the information processing terminal 50 of the above embodiment, each process executed by the controller of the present invention is realized by executing various programs stored in the memories 32 and 62 by the CPUs 31 and 61. Explained. However, the configuration of the controller is not limited to this, and a part or all of the controller configuration may be realized by hardware such as an integrated circuit.

Further, the present invention can be realized not only as the MFP 10 and the information processing terminal 50, but also as a program for causing the MFP 10 and the information processing terminal 50 to execute processing. Then, the program may be recorded and provided on a non-transitory recording medium. The non-transitory recording medium may include a memory mounted on a server that can be connected to the MFP 10 and the information processing terminal 50 through the communication network 101, in addition to a CD-ROM, a DVD-ROM, and the like. Then, the program stored in the memory of the server may be distributed as information or a signal indicating the program through a communication network 101 such as the Internet.

10 ... MFP
11 ... Printer 50 ... Information processing terminal 53 ... Display 54 ... Input I / F
55 ... Communication I / F
61 ... CPU
62 ... Memory 65 ... Postcard program 66 ... URL management program

Claims (8)

A program that can be executed by an information processing terminal that has an input interface and a communication interface.
The program
The first reception process that accepts user operations that specify multiple images through the input interface, and
A generation process of synthesizing a plurality of images specified in the first reception process to generate a print image to be printed on a print medium.
The information processing terminal is made to execute a print instruction process for transmitting print instruction information to a printer through the communication interface, and the print instruction information is information for printing the print image generated in the generation process on a print medium. can be,
A part of the plurality of images designated in the first reception process is an information holding image, and the information holding image includes a plurality of bright cells and a plurality of dark cells having a brightness lower than that of the bright cells. And the position detection image arranged at a predetermined position in the information holding image, and the address information indicating the address of the data stored in the server is held as a combination of the bright cell and the dark cell. ,
The program overlaps with the information-retaining image and is behind the information-retaining image in the overlapping direction in the generation process when the bright cell of the information-retaining image specified in the first reception process is a transparent color. The information-retaining image is rotated and combined in a direction corresponding to the positional relationship with other images located in.
The position detection image is arranged at three corners of the rectangular information holding image.
The program
In the first reception process, the user operation for designating the template image and the information holding image is received through the input interface.
In the generation process, a program that synthesizes the information holding image, which is rotated in a direction in which a corner where the position detection image is not arranged is closest to the center of the template image, with the template image. In the generation process, the program has a direction in which the corner where the position detection image is not arranged becomes closer to the center of the template image in response to the information holding image overlapping the outer edge portion having a predetermined width of the template image. program according to claim 1 for rotating the information holding image. The program
The information processing terminal is made to execute a determination process for determining whether or not the representative value of the brightness of the template image specified in the first reception process is equal to or greater than the threshold value.
In the generation process when the determination process determines that the threshold value is equal to or higher than the threshold value, the information-retaining image in which the bright cell is a transparent color has the corner where the position detection image is not arranged closest to the center of the template image. Rotate in the direction to be combined with the template image,
According to claim 1 or 2 , in the generation process when the determination process determines that the value is less than the threshold value, the information-retaining image in which the bright cell is a non-transparent color is combined with the template image in a predetermined direction. Described program. The program
In the first reception process, a user operation for designating a symbol image showing a symbol whose meaning and content can be visually recognized and the information holding image are accepted through the input interface, and the symbol image is synthesized on the template image. A possible image smaller than the template image,
The position detection image is arranged in the generation process when one of the four corners of the information holding image overlaps with the symbol image and the symbol image is located on the back side in the overlapping direction with respect to the information holding image. The program according to claim 1, wherein the information holding image whose corners are rotated so as to overlap with the symbol image is combined with the symbol image. The program
A second reception process that accepts a user operation for changing the position of the information holding image on the printed image through the input interface, and
From claim 1, the information processing terminal is made to execute the generation process of rotating and synthesizing the information holding image in a direction corresponding to the positional relationship with another image at the position changed in the second reception process. The program described in any of 4. A program that can be executed by an information processing terminal that has an input interface and a communication interface.
The program
The first reception process that accepts user operations that specify multiple images through the input interface, and
A generation process of synthesizing a plurality of images specified in the first reception process to generate a print image to be printed on a print medium.
The information processing terminal is made to execute a print instruction process for transmitting print instruction information to a printer through the communication interface, and the print instruction information is information for printing the print image generated in the generation process on a print medium. can be,
A part of the plurality of images designated in the first reception process is an information holding image, and the information holding image includes a plurality of bright cells and a plurality of dark cells having a brightness lower than that of the bright cells. And the position detection image arranged at a predetermined position in the information holding image, and the address information indicating the address of the data stored in the server is held as a combination of the bright cell and the dark cell. ,
The program overlaps with the information-retaining image and is behind the information-retaining image in the overlapping direction in the generation process when the bright cell of the information-retaining image specified in the first reception process is a transparent color. The information-retaining image is rotated and combined in a direction corresponding to the positional relationship with other images located in.
The program
The information processing terminal is made to execute the third reception process of accepting the user operation for designating the color of the bright cell of the information holding image specified in the first reception process through the input interface.
In the generation process when a transparent color is specified in the third reception process, the information-retaining image in which the bright cell is a transparent color overlaps the information-retaining image and is behind the information-retaining image in the overlapping direction. Rotate and synthesize in the direction corresponding to the positional relationship with other images located in
A program for synthesizing the information-retaining image in which the bright cell is a non-transparent color in the generation process when a non-transparent color is specified in the third reception process in a predetermined direction. Input interface and
Communication interface and
An information processing terminal equipped with a controller
The controller
The first reception process that accepts user operations that specify multiple images through the input interface, and
A generation process of synthesizing a plurality of images specified in the first reception process to generate a print image to be printed on a print medium.
A print instruction process for transmitting print instruction information to the printer through the communication interface is executed, and the print instruction information is information for printing the print image generated in the generation process on a print medium.
A part of the plurality of images designated in the first reception process is an information holding image, and the information holding image includes a plurality of bright cells and a plurality of dark cells having a brightness lower than that of the bright cells. And the position detection image arranged at a predetermined position in the information holding image, and the address information indicating the address of the data stored in the server is held as a combination of the bright cell and the dark cell. ,
The controller overlaps with the information holding image and is behind the information holding image in the overlapping direction in the generation processing when the bright cell of the information holding image designated in the first reception processing is a transparent color. The information-retaining image is rotated and combined in a direction corresponding to the positional relationship with other images located in.
The position detection image is arranged at three corners of the rectangular information holding image.
The controller
In the first reception process, the user operation for designating the template image and the information holding image is received through the input interface.
An information processing terminal that synthesizes the information holding image, which is rotated in the direction in which the corner where the position detection image is not arranged is closest to the center of the template image in the generation process, with the template image. Input interface and
Communication interface and
An information processing terminal equipped with a controller
The controller
The first reception process that accepts user operations that specify multiple images through the input interface, and
A generation process of synthesizing a plurality of images specified in the first reception process to generate a print image to be printed on a print medium.
A print instruction process for transmitting print instruction information to the printer through the communication interface is executed, and the print instruction information is information for printing the print image generated in the generation process on a print medium.
A part of the plurality of images designated in the first reception process is an information holding image, and the information holding image includes a plurality of bright cells and a plurality of dark cells having a brightness lower than that of the bright cells. And the position detection image arranged at a predetermined position in the information holding image, and the address information indicating the address of the data stored in the server is held as a combination of the bright cell and the dark cell. ,
The controller overlaps with the information holding image and is behind the information holding image in the overlapping direction in the generation processing when the bright cell of the information holding image designated in the first reception processing is a transparent color. The information-retaining image is rotated and combined in a direction corresponding to the positional relationship with other images located in.
The controller
The third reception process of accepting the user operation for specifying the color of the bright cell of the information holding image specified in the first reception process through the input interface is executed.
In the generation process when a transparent color is specified in the third reception process, the information-retaining image in which the bright cell is a transparent color overlaps the information-retaining image and is behind the information-retaining image in the overlapping direction. Rotate and synthesize in the direction corresponding to the positional relationship with other images located in
An information processing terminal that synthesizes the information holding image in which the bright cell is a non-transparent color in the generation process when a non-transparent color is specified in the third reception process in a predetermined direction.

Images