JP6743591B2 - Program and information processing terminal - Google Patents

Description

The present invention relates to a program of an information processing terminal that edits an image printed on the communication surface of a postcard.

For example, Patent Document 1 discloses a program of an information processing terminal that edits an image printed on the communication surface of a postcard. More specifically, the program described in Patent Document 1 causes the user to select one of the plurality of template images, causes the user to edit the selected template image, and edits the edited template image on the communication surface of the postcard. The printer can be made to execute the printing operation to be recorded in.

Further, in recent years, as described in Patent Document 2, for example, a technique of printing a QR code (registered trademark) indicating a URL for accessing information on the Internet on a printed material has become widespread. Then, the QR code printed on the printed matter is read by the camera of the mobile terminal, and the URL is extracted from the read QR code, whereby the information on the Internet indicated by the URL can be accessed.

JP, 2016-081299, A JP, 2011-078071, A

In order to extract the URL from the QR code, it is necessary that a plurality of squares forming the QR code are printed in an appropriate positional relationship. However, compared to a large size sheet such as an A4 size sheet, it is difficult to print a QR code that can be correctly read by a camera and the like on a small size printed matter such as a postcard.

The present invention has been made in view of the above circumstances, and an object thereof is to provide a program of an information processing terminal that can appropriately combine a QR code with a template image printed on the communication surface of a postcard. is there.

Various disclosures are made herein. The program, which is one of the disclosed examples, can be executed by an information processing terminal including a display and an input interface. The program includes a first reception process for receiving a user operation for designating an additional image to be combined with a template image through the input interface, and the template image obtained by combining the additional image specified in the first reception process. The information processing terminal is made to repeatedly execute the display processing to be displayed on the display. The template image is an image printed on the communication surface of the postcard. The additional image is a pattern image showing a visually recognizable pattern, or an information holding image that holds information that can be extracted by image processing after being optically read. In the display processing when the symbol image is designated in the first and second times of the first acceptance processing, the program executes the first and second times of the symbol image designated in the first acceptance processing of the second time. The information image is displayed on the front side in the depth direction with respect to the symbol image designated in the first acceptance process, the information holding image is designated in the first acceptance process for the first time, and the symbol is designated in the first reception process for the second time. In the display processing when an image is designated, the information holding image is displayed on the front side in the depth direction with respect to the symbol image.

Since the design image shows the design visually recognized by the user, even if a part of the design image is hidden, a big problem does not occur. On the other hand, since the information-holding image is optically read by a camera or the like and then subjected to image processing to extract the information, the information cannot be properly extracted if a part of the image is hidden. Therefore, as in the above configuration, when both the pattern image and the information holding image are combined with the template image, by arranging the information holding image on the front side in the depth direction with respect to the pattern image, the information holding image is hidden by the pattern image. Can be suppressed.

FIG. 1 is a block diagram of a printing system 100 according to the embodiment. FIG. 2 shows an example of data stored in the memory 62, where (A) shows a stamp list and (B) shows a URL list. FIG. 3 is a flowchart of the communication surface editing process. FIG. 4 is a flowchart of the stamp combining process. FIG. 5 is a flowchart of the stamp editing process. 6A and 6B show display examples of the display 53, where FIG. 6A shows a template selection screen and FIG. 6B shows a template editing screen. 7A and 7B show display examples of the display 53. FIG. 7A shows a stamp selection screen 130 and FIG. 7B shows a URL selection screen 140. 8A and 8B show display examples of the display 53, where FIG. 8A shows an issuance confirmation screen 150, and FIG. 8B shows a stamp edit screen in a state where the QR stamp 171 is combined. FIG. 9 is a display example of the display 53, (A) shows a stamp edit screen after the QR stamp 171 is moved, and (B) shows a stamp edit state in which the QR stamp 171 and the pattern stamp 172 are combined. Show the screen. FIG. 10 is a display example of the display 53, (A) shows a stamp edit screen in which the QR stamp 171 and the pattern stamp 172 are in a non-designated state, and (B) shows a replacement confirmation screen 180. FIG. 11 is a display example of the display 53, (A) shows a stamp edit screen in which the design stamp 172 and QR stamp 173 are combined, and (B) shows the design stamp 172 and QR stamp 173 combined. The template edit screen of a state is shown.

Hereinafter, embodiments of the present invention will be described with reference to the drawings as appropriate. The embodiment described below is merely an example of the present invention, and it goes without saying that the embodiment of the present invention can be appropriately changed without changing the gist of the present invention.

FIG. 1 is a schematic diagram of a printing system 100 according to this embodiment. The printing system 100 shown in FIG. 1 includes an MFP (abbreviation of Multi-Function Peripheral) 10 and an information processing terminal 50. The printing system 100 may include a printer single-function device instead of the MFP 10.

The MFP 10 and the information processing terminal 50 are configured to be able to communicate with each other through the communication network 101. The specific example of the communication network 101 is not particularly limited, but may be, for example, the Internet, a wired LAN, a wireless LAN, or a combination thereof. Alternatively, the MFP 10 and the information processing terminal 50 may be connected by a USB cable or the like. Further, the information processing terminal 50 can communicate with the server 80 on the Internet.

As shown in FIG. 1, the MFP 10 mainly includes a printer 11, a scanner 12, a display 23, an input I/F 24, a communication I/F 25, a CPU 31, a memory 32, and a communication bus 33. .. The constituent elements of the MFP 10 are connected to each other via the communication bus 33.

The printer 11 executes a printing operation for printing an image represented by image data on a sheet. As the printing method of the printer 11, a known method such as an inkjet method or an electrophotographic method can be adopted. The scanner 12 performs a scanning operation of reading an image printed on a document and generating image data. However, the scanner 12 can be omitted.

The display 23 is a liquid crystal display, an organic EL display, or the like, and includes a display screen that displays various types of information.

The input I/F 24 is a user interface that receives an input operation by the user. Specifically, the input I/F 24 has a button, and outputs various operation signals associated with the pressed button to the CPU 31. Furthermore, the input I/F 24 may include a film-shaped touch sensor that is superimposed on the display surface of the display 23. The operation of designating an object displayed on the display surface of the display 23 and the operation of inputting a character string or a number string are examples of user operations. The "object" is, for example, a character string displayed on the display 23, an icon, a button, a link, a radio button, a check box, a pull-down menu, or the like.

The input I/F 24 implemented as a touch sensor outputs position information indicating the position touched by the user on the display surface. It should be noted that the term “touch” in this specification includes all operations of bringing the input medium into contact with the display surface. Also, even if the input medium does not touch the display surface, "hover" or "floating touch" that brings the input medium close to a position where the distance between the input medium and the display surface is very small is defined as the concept of "touch". May be included. Further, the input medium may be a user's finger, a touch pen, or the like. The user operation of tapping the position of the object displayed on the display 23 is an example of the user operation of designating the object.

The communication I/F 25 is an interface capable of communicating with an external device via the communication network 101. That is, the MFP 10 transmits various information to the external device through the communication I/F 25 and receives various information from the external device through the communication I/F 25. The specific communication procedure of the communication I/F 25 is not particularly limited, but Wi-Fi (registered trademark of Wi-Fi Alliance) can be used, for example. When the MFP 10 and the information processing terminal 50 are connected by a USB cable, the communication I/F 25 may be a USB interface to which the USB cable can be attached/detached.

The CPU 31 controls the entire operation of the MFP 10. The CPU 31 acquires various programs, which will be described later, from the memory 32 and executes the programs, based on various information output from the input I/F 24, various information received from an external device through the communication I/F 25, and the like. The CPU 31 and the memory 32 form an example of a controller.

The memory 32 stores an OS 34 and a device program 35. The device program 35 may be a single program or an aggregate of a plurality of programs. Further, the memory 32 stores data or information necessary for executing the device program 35. The memory 32 is composed of, for example, a RAM, a ROM, an EEPROM, a HDD, a portable storage medium such as a USB memory that is attached to and detached from the MFP 10, a buffer included in the CPU 31, or a combination thereof.

The memory 32 may be a computer-readable storage medium. The computer-readable storage medium is a non-transmission medium. In addition to the above examples, the non-transmission medium also includes a recording medium such as a CD-ROM and a DVD-ROM. The non-transmission medium is also a tangible medium. On the other hand, an electric signal that carries a program downloaded from a server or the like on the Internet is a computer-readable signal medium that is a kind of computer-readable medium, but a non-transitory computer-readable storage medium. Not included in the media. The same applies to the memory 62 of the information processing terminal 50 described later.

As shown in FIG. 1, the information processing terminal 50 mainly includes a display 53, an input I/F 54, a communication I/F 55, a CPU 61, a memory 62, and a communication bus 63. The display 53, the input I/F 54, the communication I/F 55, the CPU 61, the memory 62, and the communication bus 63 included in the information processing terminal 50 include the display 23, the input I/F 24, the communication I/F 25, the CPU 31, which are included in the MFP 10. The configuration is the same as that of the memory 32 and the communication bus 33, and the description thereof will be omitted. The CPU 61 and the memory 62 are an example of a controller.

The information processing terminal 50 is, for example, a mobile phone, a smartphone, a tablet terminal, a PC, or the like. More specifically, it is desirable that the display 53 of the information processing terminal 50 has a display screen size of 12 inches or less, and more preferably 8 inches or less. The input I/F 54 of the information processing terminal 50 is preferably a touch panel overlaid on the display screen of the display 53.

The memory 62 stores an OS 64. The OS 64 may be, for example, Windows (registered trademark of Microsoft Corporation) Operating System, Android (registered trademark of Google inc.) OS, iOS (registered trademark of Cisco Systems, Inc.), or the like. The OS 64 can execute a plurality of programs installed in the information processing terminal 50 in parallel. The plurality of programs are virtually executed in parallel by a time division multiplexing method, for example. Further, the OS 64 executes one of a plurality of programs executed in parallel in the foreground, and executes the other programs in the background. The foreground is, for example, a state in which the screen generated by the program is displayed on the display 53. The background is, for example, a state in which the screen generated by the program is not displayed on the display 53.

The memory 62 also stores a postcard program 65 and a URL management program 66. The postcard program 65 is a program that causes the MFP 10 to execute a printing process of generating an image to be recorded on the address side and the communication side of the postcard according to a user's instruction, and printing the generated image on the postcard. The postcard program 65 may cause the MFP 10 to execute print processing through another program installed in the information processing terminal 50. The URL management program 66 is an example of an external program that uploads content data to the server 80 on the Internet and manages address information indicating the address of the content data stored in the server 80. The content data refers to, for example, image data, photo data, moving image data, HTML data, or the like. The address information is, for example, URL format information.

Further, the memory 62 can store the stamp list shown in FIG. The stamp list includes one or more stamp records. The stamp record includes a stamp ID, stamp data, position information, and depth information. The postcard program 65 registers the stamp record corresponding to the stamp in the stamp list in response to the stamp being combined with the template image according to the user's instruction.

The stamp ID is identification information that uniquely identifies the stamp combined with the template image, and is assigned by the postcard program 65. The stamp data is image data indicating a stamp combined with the template image. The position information indicates the position on the template image where the stamps are combined. The depth information indicates positions in the depth direction of a plurality of stamps combined on the template image.

The position information is specified based on, for example, the upper left end position of the template image having a width of 1000 pixels and a length of 1500 pixels. More specifically, the position of the rectangular stamp is specified by the left end position “left”, the upper end position “top”, the right end position “right”, and the lower end position “bottom”. In the depth information, for example, among integers 1 to 9, a small integer is assigned to a stamp located on the front side in the depth direction, and a large integer is assigned to a stamp located on the back side in the depth direction.

Further, the memory 62 can store the URL list shown in FIG. The URL list includes one or more URL records. The URL record includes name information and a URL. In response to uploading the content data to the server 80, the URL management program 66 registers a URL record containing the URL of the content data and the name information input by the user through the input I/F 54 in the URL list. ..

The memory 62 can also store template image data (not shown). The template image data indicates a template image printed on the communication surface of the postcard. In the present embodiment, an example of a template image printed on the communication surface of a New Year's card will be described, but the application of the template image is not limited to this, and can be applied to, for example, a summer visit, a Christmas card, and the like.

Further, the memory 62 can store symbol stamp data (not shown). The symbol stamp data is image data showing a symbol stamp which is an example of a symbol image. The design stamp is, for example, an image showing the zodiac or pictograms. In addition to the pattern stamp, the stamp includes a QR stamp which is an example of an information holding image. The pattern stamp and the QR stamp (collectively referred to as “stamp” in some cases) are examples of additional images that can be combined on the template image, and have a smaller image size than the template image.

The design stamp is an image showing a design whose meaning content can be visually recognized. On the other hand, the QR stamp is an image representing a QR code (registered trademark), and it is extremely difficult to visually recognize the meaning and content. The QR stamp is an image that holds address information indicating the address of the content data stored in the server 80. More specifically, the QR stamp is an image that holds information that can be extracted by image processing by a program after being optically read by a camera or the like. Note that a specific example of the information holding image is not limited to the QR code, and may be Data Matrix or the like. In other words, the information holding image may be an image representing a so-called two-dimensional barcode.

[Operation of Printing System 100]
The operation of the printing system 100 according to this embodiment will be described with reference to FIGS.

[Communication surface editing process]
First, the postcard program 65 executed in the foreground causes the display 53 to display the template selection screen shown in FIG. 6A (S11). The template selection screen includes a plurality of template icons 111, 112, 113, 114. The template icons 111 to 114 correspond to one of the plurality of template image data stored in the memory 62. Then, the postcard program 65 receives a user operation on the template selection screen through the input I/F 54 (S12).

Next, the postcard program 65, for example, in response to receiving the designation of the template icon 113 through the input I/F 54 (S12: Yes), stores the template image data associated with the designated template icon 113 in the memory 62. Read from. Next, the postcard program 65 displays the template edit screen shown in FIG. 6B on the display 53 instead of the template selection screen (S13). Then, the postcard program 65 receives a user operation on the template editing screen through the input I/F 54 (S14).

The template editing screen includes a template image 121, a font icon 123, a stamp icon 124, a [save] icon 125, and a [print] icon 126. The template image 121 is an image indicated by the read template image data. The font icon 123 corresponds to an instruction to switch the font of the characters included in the template image 121 (for example, Gothic font, Mincho font, etc.). The stamp icon 124 corresponds to an instruction to select a stamp to be combined with the template image 121. The [Save] icon 125 corresponds to an instruction to store the edited template image data in the memory 62. The [print] icon 126 corresponds to an instruction to print the edited template image 121 on the communication surface of the postcard.

Next, the postcard program 65 executes the stamp combining process in response to the designation of the stamp icon 124 received through the input I/F 54 (S14: stamp) (S15). The stamp combining process is a process of combining a stamp with the template image 121. Details of the stamp combining process will be described with reference to FIG.

[Stamp synthesis processing]
First, the postcard program 65 displays the stamp selection screen 130 shown in FIG. 7A on the display 53 instead of the template editing screen (S21). The stamp selection screen 130 includes a switching tab 131 in a selected state, a switching tab 132 in a non-selected state, and stamp icons 133, 134, 135, 136. The stamp icons 133 to 136 correspond to one of the stamp data stored in the memory 62. Then, the postcard program 65 receives a user operation on the stamp selection screen 130 through the input I/F 54 (S22). The process of S22 is an example of the first reception process.

The stamp selection screen 130 according to the present embodiment is a pop-up window that is displayed so as to be superimposed on a stamp editing screen described later. That is, the stamp selection screen 130 has a smaller screen size than the stamp editing screen. The same applies to the URL selection screen 140, the issuance confirmation screen 150, and the replacement confirmation screen 180 described below.

Next, the postcard program 65 receives the designation of the switching tab 132 in the non-selected state through the input I/F 54 (S22: tab), and changes the URL list shown in FIG. It is acquired from 66 (S27). The postcard program 65 activates the URL management program 66 using, for example, the activation API provided by the OS 64 to activate the external program. Next, the postcard program 65 acquires a pointer indicating the start address of the memory area that stores the URL list as the return value of the activation API. Then, the postcard program 65 reads the URL record from the memory area indicated by the acquired pointer.

Next, the postcard program 65 displays the URL selection screen 140 shown in FIG. 7B on the display 53 instead of the stamp selection screen 130 (S28). The URL selection screen 140 includes a non-selected switching tab 131, a selected switching tab 132, and URL icons 141 and 142. The URL icons 141 and 142 correspond to one of the URL records acquired in S27. Further, in the URL icons 141 and 142, the character string indicated by the name information of the corresponding URL record is described. Then, the postcard program 65 receives a user operation on the URL selection screen 140 through the input I/F 54 (S29). The process of S29 is an example of the first reception process.

Next, the postcard program 65 receives the designation of the switching tab 131 in the non-selected state through the input I/F 54 (S29: tab) and displays the stamp selection screen 130 shown in FIG. Instead of the selection screen 140, it is displayed on the display 53 (S21). On the other hand, the postcard program 65 determines whether or not the number of QR stamps already combined in the template image 121 is equal to or more than a threshold value in response to the designation of the URL icon 141 received through the input I/F 54 (S29: URL). A judgment is made (S30). The threshold value is typically 1, but may be 2 or more. The tap of the URL icon 141 is an example of a combination instruction operation. The process of S30 is an example of the determination process.

Next, the postcard program 65 displays the issue confirmation screen 150 shown in FIG. 8A in response to determining that the number of QR stamps already combined in the template image 121 is less than the threshold value (S30: No). To do so, the URL management program 66 is activated using the activation API (S31). As a result, the OS 64 executes the postcard program 65 in the background and the URL management program 66 in the foreground. The process of S31 is an example of the activation process.

In response to being activated by the postcard program 65, the URL management program 66 causes the display 53 to display the issue confirmation screen 150 shown in FIG. The issuance confirmation screen 150 includes a representative image 151, a message “Is the QR code for “Family Travel Movie” issued?”, an “Issue” icon 152, and a “Cancel” icon 153. Then, the URL management program 66 receives a user operation on the issuance confirmation screen 150 through the input I/F 54.

The representative image 151 is an image included in the content data indicated by the URL of the URL record corresponding to the URL icon 141. As an example, when the content data is moving image data, the representative image 151 is an image showing one scene of the moving image data. As another example, the representative image 151 when the content data is still image data is the still image itself shown by the still image data. The [Issue] icon 152 corresponds to an instruction to issue a QR stamp holding the URL of the URL record corresponding to the URL icon 141. The [Cancel] icon 153 corresponds to an instruction not to issue a QR stamp.

Next, the URL management program 66 receives the designation of the [Issue] icon 152 or the [Cancel] icon 153 through the input I/F 54, and sets the information indicating the designated icon as the return value of the activation API. Provide to the postcard program 65. As a result, the OS 64 executes the postcard program 65 in the foreground and the URL management program 66 in the background.

Next, the postcard program 65 determines which of the [issue] icon 152 and the [cancel] icon 153 is designated based on the information acquired as the return value of the activation API (S32). Then, when the postcard program 65 determines that the [Cancel] icon 153 is designated (S32: Cancel), the stamp combining process ends without executing the processes of S33 and thereafter.

On the other hand, when the postcard program 65 determines that the [Issue] icon 152 is specified (S32:Issue), the QR stamp 171 holding the URL of the URL record corresponding to the URL icon 141 is processed according to a known algorithm. To generate. Then, the postcard program 65 combines the generated QR stamp 171 with the QR initial position of the template image 121 (S33). The QR initial position is a predetermined position as a position for combining the QR stamp 171. The process of S33 for newly combining the QR stamp 171 with the template image 121 is an example of the combining process.

Further, the postcard program 65 uses the stamp ID “001”, the stamp data “QR stamp 1.JPEG” indicating the QR stamp 171, and the position information “left=450, top=700, right=550 indicating the QR initial position, A stamp record including “bottom=800” and depth information “1” is registered in the stamp list. When the threshold value in S30 is 1, depth information "1" is always assigned to the QR stamp.

Next, the postcard program 65 causes the display 53 to display the stamp editing screen shown in FIG. 8B (S24). The process of S24 is an example of the display process. The stamp editing screen shown in FIG. 8B includes a template image 121 on which a QR stamp 171 is combined, an “add stamp” icon 161, and a “decide” icon 162. The “add stamp” icon 161 corresponds to an instruction to add a stamp to be combined with the template image 121. The [OK] icon 162 corresponds to an instruction to end the stamp combining process. Then, the postcard program 65 receives a user operation on the stamp edit screen through the input I/F 54 (S25). The process of S25 is an example of the second reception process.

Note that the QR stamp 171 is in the designated state on the stamp edit screen shown in FIG. 8B. The “stamp in the designated state” means that the stamp is a target of the stamp editing process described later. The stamp in the designated state is an example of the designated image. On the other hand, the “non-designated stamp” indicates that the stamp is not the target of the stamp editing process. Then, the edit icon 163 is added to the designated QR stamp 171. The edit icon 163 is an example of the first edit object corresponding to the instruction to delete the QR stamp 171. On the other hand, the QR stamp 171 in the designated state is not added with the edit icons 164 and 165 described later.

Next, the postcard program 65 executes the stamp editing process in response to the user operation for the position of the template image 121 being received through the input I/F 54 (S25: template image) (S26). The stamp editing process is a process of editing the stamp combined with the template image 121 according to a user's instruction. Details of the stamp editing process will be described with reference to FIG.

[Stamp edit processing]
For example, the postcard program 65 follows the movement of the input medium on the template image 121 in response to receiving the drag operation for the position of the QR stamp 171 through the input I/F 54 (S43: Yes), and then sets the QR stamp 171. It is translated (S49). The drag operation on the position of the QR stamp 171 is an example of a move instruction operation. The process of S43 is an example of the third reception process, and the process of S49 is an example of the moving process. Then, returning to FIG. 4, the postcard program 65 causes the display 53 to display a stamp edit screen including the template image 121 in which the QR stamp 171 is combined at a new position, as shown in FIG. 9A. S24).

More specifically, the postcard program 65 detects the moving direction and the moving amount of the input medium touched at the position of the QR stamp 171 through the touch sensor. Next, the postcard program 65 moves the QR stamp 171 on the template image 121 by the detected movement amount in the detected movement direction. Then, the postcard program 65 updates the position information of the stamp record with the position information “left=350, top=450, right=450, bottom=550” of the QR stamp 171 after the movement.

Next, the postcard program 65 executes the processing from S21 again in response to receiving the designation of the [add stamp] icon 161 through the input I/F 54. Then, the postcard program 65 receives the designation of the stamp icon 133 of FIG. 7A through the input I/F 54 (S22: stamp), and then, as shown in FIG. The pattern stamp 172 corresponding to 133 is further combined with the pattern initial position of the template image 121 with which the QR stamp 171 is combined (S23). The symbol initial position is a predetermined position as a position where the symbol stamp 172 is combined. Further, the symbol initial position may be a position different from the QR initial position described above.

Further, the postcard program 65 has the stamp ID “002”, the stamp data “Bird-01.JPEG” indicating the symbol stamp 172, and the positional information “left=400, top=500, right=500, which indicates the symbol initial position. A stamp record including bottom=600” and depth information “9” is registered in the stamp list. It should be noted that the depth information is set to a larger value as the pattern stamp previously combined with the template image. That is, the pattern stamp synthesized first is synthesized on the back side in the depth direction of the pattern stamp synthesized later. Further, the depth information of the symbol stamp is always set to a larger value than the depth information of the QR stamp.

Next, the postcard program 65 causes the display 53 to display the stamp editing screen shown in FIG. 9B (S24). The stamp edit screen shown in FIG. 9B includes a template image 121 in which a QR stamp 171 and a pattern stamp 172 are combined, an “add stamp” icon 161, and a “decide” icon 162. In the stamp edit screen shown in FIG. 9B, the QR stamp 171 is in the non-designated state, and the design stamp 172 is in the designated state.

Edit icons 163, 164, and 165 are added to the design stamp 172 in the designated state. The edit icon 164 is an example of a second edit object corresponding to an instruction to enlarge or reduce the pattern stamp 172. The edit icon 165 is an example of a second edit object corresponding to an instruction to rotate the design stamp 172. On the other hand, the edit icon 163 is not added to the QR stamp 171 in the non-designated state. When a part of the non-designated QR stamp 171 and the designated design stamp 172 overlap each other, the postcard program 65 sets the designated design stamp 172 to the QR stamp 171 regardless of the depth information setting value. It is displayed on the near side in the depth direction.

Next, the postcard program 65, for example, in response to receiving a user operation of tapping a position different from the design stamp 172 in the designated state through the input I/F 54 (S42: Yes), sets the design stamp 172 to the non-designated state. Switch to the designated state (S47). Further, the postcard program 65 arranges the QR stamp 171 in the non-designated state on the front side in the depth direction with respect to the design stamp 172 in the non-designated state (S48). Then, the postcard program 65 displays the stamp edit screen shown in FIG. 10A on the display 53 (S24). The edit icons 163-165 are not added to the symbol stamp 172 in the non-designated state. The tap at a position different from the stamp in the designated state is an example of a release operation for releasing the designated state. The process of S48 is an example of the second switching process.

In addition, the postcard program 65 receives the user operation of tapping the position of the symbol stamp 172 in the non-designated state through the input I/F 54 (S41: Yes), and changes the symbol stamp 172 from the non-designated state to the designated state. Switch (S45). Further, the postcard program 65 arranges the symbol stamp 172 in the designated state on the front side in the depth direction with respect to the QR stamp 171 in the non-designated state (S46). Then, the postcard program 65 displays the stamp edit screen shown in FIG. 9B on the display 53 (S24). The tap of the position of the non-designated stamp is an example of the designation operation for designating the stamp in the designated image. The process of S46 is an example of the first switching process.

Next, the postcard program 65, for example, specifies the [Add stamp] icon 161, the switching tab 132 of the stamp selection screen 130, and the URL icon 142 of the URL selection screen 140 in this order on the stamp editing screen of FIG. In response to the acceptance (S22:Tab & S29:URL), it is determined that the number of QR stamps already combined with the template image 121 is equal to or more than the threshold value (S30:Yes).

Then, the postcard program 65 causes the display 53 to display the replacement confirmation screen 180 shown in FIG. 10B (S34). The replacement confirmation screen 180 includes a message “Multiple QR codes cannot be arranged. Do you want to overwrite?”, a [Cancel] icon 181, and an [OK] icon 182. Then, the postcard program 65 receives the user operation on the replacement confirmation screen 180 through the input I/F 54 (S35).

Next, the postcard program 65 ends the stamp combining process without executing the processes from S31 in response to receiving the designation of the [Cancel] icon 181 through the input I/F 54 (S35: Cancel). On the other hand, the postcard program 65 executes the processes from S31 onward in response to the designation of the [OK] icon 182 being accepted through the input I/F 54 (S35:OK). The processing of S31 and S32 is common to the above-mentioned processing. Tapping the [Cancel] icon 181 is an example of a cancel operation, and tapping the [OK] icon 182 is an example of a replacement instruction operation.

On the other hand, the postcard program 65 generates the QR stamp 173 holding the URL of the URL record corresponding to the URL icon 142 according to a well-known algorithm in S33. Then, the postcard program 65 deletes the QR stamp 171 already combined with the template image 121 and combines the generated QR stamp 173 at the QR initial position of the template image 121. The QR stamp 171 is an example of a first information holding image, and the QR stamp 173 is an example of a second information holding image. The process of S33 in which the QR stamp 171 is deleted and the QR stamp 173 is combined is an example of the replacement process.

Also, the postcard program 65 sets the stamp record including the stamp ID “001” to the stamp data “QR stamp 2.JPEG” indicating the QR stamp 173, the position information “left=450, top=700, right” indicating the QR initial position. =550, bottom=800”, and depth information “1”. Further, the postcard program 65 causes the display 53 to display the stamp editing screen shown in FIG. 11(A) (S24). Then, the postcard program 65 displays the QR stamp 173 in the designated state on the front side of the depth information with respect to the symbol stamp 172 in the non-designated state on the stamp editing screen shown in FIG. 11(A).

In addition, the postcard program 65 receives the tap operation at the position of the edit icon 163 added to the designated QR stamp 171 through the input I/F 54 (S44: Yes). The QR stamp 171 is deleted (S50), and the stamp edit screen in which the QR stamp 171 is deleted is displayed on the display 53 (S24). The same applies when the design icon 172 in the designated state and the edit icon 163 added to the QR stamp 173 in the designated state are designated.

In addition, the postcard program 65 responds to the movement of the input medium in response to accepting a drag operation for the position of the edit icon 164 added to the designated pattern stamp 172 through the input I/F 54 (S44: Yes). The size of the design stamp 172 is changed by the magnification (S50), and a stamp edit screen including the template image 121 in which the resized design stamp 172 is combined is displayed on the display 53 (S24). The expansion of the stamp is realized, for example, by interpolating a number of pixels according to the expansion rate. The reduction of the stamp is realized, for example, by thinning out the number of pixels according to the reduction rate.

Further, the postcard program 65 receives the drag operation for the position of the edit icon 165 added to the designated pattern stamp 172 through the input I/F 54 (S44: Yes), and then the pattern stamp on the template image 121. 172 is rotated (S50), and a stamp edit screen including the template image 121 on which the rotated design stamp 172 is combined is displayed on the display 53 (S24). The rotation of the stamp is realized using, for example, an affine transformation matrix.

The processing of S43 and S44 is an example of the third reception processing. The process of moving the stamp in parallel on the template image 121 and the process of deleting the stamp from the template image 121 are the first editing process of editing the stamp by a method in which the relative positions of a plurality of pixels forming the stamp do not change. This is an example. On the other hand, the process of enlarging, reducing, and rotating the stamp on the template image 121 is an example of the second editing process of editing the stamp by a method in which the relative positions of a plurality of pixels forming the stamp may change. is there.

Next, the postcard program 65 receives, for example, the designation of the [Determination] icon 162 of FIG. 11A through the input I/F 54 (S25: determination), and then the template shown in FIG. 11B. The edit screen is displayed on the display 53 instead of the stamp edit screen (S13). Further, the postcard program 65 causes the plurality of stamps 172 and 173 to be displayed closer to the front side in the depth direction as the set value of the depth information is smaller on the template editing screen. That is, as shown in FIG. 11B, the QR stamp 173 is displayed on the front side in the depth direction with respect to the design stamp 172.

Further, the postcard program 65 switches the font of the character string included in the template image 121 in response to the designation of the font icon 123 on the template editing screen received through the input I/F 54. In addition, the postcard program 65 stores the edited template image data in the memory 62 in response to the designation of the [Save] icon 125 on the template editing screen received through the input I/F 54.

Further, the postcard program 65 transmits the print instruction information to the MFP 10 through the communication I/F 55 in response to the designation of the [print] icon 126 on the template edit screen received through the input I/F 54 (S14:print). S16). The print instruction information is information for causing the MFP 10 to execute the print operation of printing the edited template image 121 on the communication surface of the postcard. The print instruction information includes template image data indicating the template image 121 in which the QR stamp 173 is combined with the pattern stamp 172 on the front side in the depth direction. The process of S16 is an example of the print instruction process.

On the other hand, although illustration is omitted, the device program 35 of the MFP 10 receives the print instruction information from the information processing terminal 50 through the communication I/F 25. Then, the device program 35 causes the printer 11 to execute the printing operation according to the received print instruction information. That is, the printer 11 prints the template image 121 indicated by the template image data included in the print instruction information on the communication surface of the postcard.

[Operation and effect of this embodiment]
According to the above-described embodiment, a plurality of stamps can be combined with the template image 121 by repeatedly executing the processing of S21 to S35. In the above embodiment, an example has been described in which each stamp is combined with the template image 121 in the order of the QR stamp 171, the pattern stamp 172, and the QR stamp 173. However, the order in which the stamp is combined with the template image 121 is not limited to the above example. Similarly, the order of editing the stamps 171 to 173 by the stamp editing process is not limited to the above example.

As an example, when the pattern stamp A is combined the first time and the pattern stamp B is combined the second time, when both the pattern stamps A and B are in the non-designated state, the pattern stamp B is displayed. Is displayed on the front side in the depth direction with respect to the pattern stamp A. On the other hand, on the stamp edit screen, when the design stamp A is in the designated state and the design stamp B is in the non-designated state, the design stamp A is displayed in front of the design stamp B in the depth direction. Further, on the stamp edit screen, when the design stamp A is in the non-designated state and the design stamp B is in the designated state, the design stamp B is displayed in front of the design stamp A in the depth direction.

As another example, when the QR stamp is combined for the first time and the design stamp is combined for the second time, the QR stamp is displayed on the stamp edit screen when both the QR stamp and the design stamp are undesignated. It is displayed on the front side in the depth direction from the design stamp. Further, on the stamp edit screen, when the QR stamp is in the designated state and the design stamp is in the non-designated state, the QR stamp is displayed on the front side in the depth direction of the design stamp. On the other hand, in the stamp edit screen, when the QR stamp is in the non-designated state and the design stamp is in the designated state, the design stamp is displayed on the front side in the depth direction of the QR stamp.

That is, when a plurality of stamps are combined with the template image 121 and all the stamps are in the non-designated state, the stamp having the smaller depth information setting value is arranged closer to the front side in the depth direction. The order of the plurality of stamps to be combined with the template image included in the print instruction information is also the same. On the other hand, when one of the plurality of stamps is in the designated state, the stamp in the designated state is displayed on the most front side in the depth direction regardless of the set value of the depth information.

Since the design stamp 172 shows a design that the user visually recognizes, even if a part of the design stamp is hidden, a big problem does not occur. On the other hand, since the QR stamps 171 and 173 are optically read by a camera or the like and then subjected to image processing to extract the URL, the URL cannot be properly extracted if a part of the QR stamp is hidden.

Therefore, for example, as shown in FIG. 10(A), when both the QR stamp 171 and the symbol stamp 172 are in the non-designated state, by arranging the QR stamp 171 on the front side in the depth direction with respect to the symbol stamp 172, It is possible to suppress the QR stamp 171 from being hidden by the design stamp 172. The same applies when the template image 121 is recorded on the communication surface of the postcard. On the other hand, as shown in FIG. 9B, when the QR stamp 171 is in the non-designated state and the design stamp 172 is in the designated state, the design stamp 172 in the designated state is displayed on the most front side in the depth direction. This allows the user to confirm the entire design stamp 172 in the designated state.

Further, according to the above-described embodiment, of the plurality of edit icons 163, 164, 165, all the edit icons 163-165 are added to the design stamp 172 in the designated state, and the QR stamps 171 and 173 in the designated state are edited. Only the icon 163 is added. Further, the postcard program 65 receives a drag operation of the symbol stamp 172 and the QR stamps 171 and 173. That is, the postcard program 65 permits movement, expansion, contraction, rotation, and deletion of the symbol stamp 172, permits movement and deletion of the QR stamps 171, 173, and restricts expansion and contraction and rotation of the QR stamps 171, 173. As a result, it is possible to prevent the URL from being unable to be extracted because the relative positions of the plurality of squares forming the QR stamps 171 and 173 change.

Note that the first editing process permitted for the QR stamps 171 and 173 is not limited to the above example. That is, the first editing process may be a method in which the QR stamps 171 and 173 before and after the editing have similar shapes. More specifically, the first editing process is a process of rotating the QR stamps 171 and 173 at a rotation angle that is an integral multiple of 90°, and the QR stamps 171 and 173 are multiplied by N ² (N is a natural number not including 0) times. It may be a process of enlarging or a process of reducing the QR stamps 171 and 173 by (1/N ² ) times.

However, if the reduction ratio of the QR stamps 171 and 173 is too large, a camera with low resolution may not be able to properly recognize the plurality of squares forming the QR code. Therefore, a lower limit value may be set for the reduction rate of the QR stamps 171 and 173. On the other hand, in the second editing process, the design stamp 172 may be rotated at a rotation angle different from an integral multiple of 90° (for example, 30°, 45°, 60°, etc.), or an enlargement ratio different from N ² times ( For example, the pattern stamp 172 may be enlarged by 1.5 times, 2 times, or the like, or the pattern stamp 172 may be reduced at a reduction ratio different from (1/N ² ) times (for example, 4/5 times, 1/2 times). 172 may be reduced.

Further, according to the above-described embodiment, the number of QR stamps to be combined with the template image 121 is limited to less than the threshold value, so that it is possible to prevent the URLs from being extracted from the QR stamps due to the QR stamps being close to or overlapping with each other. it can. On the other hand, when the QR stamp 171 is already combined with the template image 121, the QR stamp 171 is replaced with the QR stamp 173. As a result, a desired QR stamp can be combined with the template image 121 without increasing the number of QR stamps combined with the template image 121.

It should be noted that some OS 64 cannot pass image data as a return value of the activation API. That is, in order for the user to confirm the representative image 151, it is necessary to instruct the URL management program 66 to display the issue confirmation screen 150. On the other hand, when the URL management program 66 is started by the start API, a so-called splash screen including the logo of the URL management program 66 and the like is displayed.

Therefore, if the URL management program 66 is activated in the middle of the process, there is a possibility that the process for synthesizing the QR stamp will take a long time and the user may be surprised by the splash screen. Therefore, as in the above-described embodiment, by confirming with the user whether to replace the QR stamps 171 and 173 before starting the URL management program 66, the URL management program 66 can be started unnecessarily. Can be suppressed.

Since the QR stamp is an image formed by combining a plurality of squares, it is difficult to distinguish the QR stamps 171 and 173 at first glance. Therefore, by synthesizing the QR stamp 173 at a position different from the QR stamp 171 on the template image 121 as in the above embodiment, the user can easily recognize that the QR stamps 171 and 173 have been replaced. ..

In the above embodiment, if the QR stamp 171 is replaced with the QR stamp 173 while the QR stamp 171 is arranged at the QR initial position, it is difficult for the user to recognize the replacement. Therefore, the postcard program 65 may place the QR stamp 173 at a position different from the current position of the QR stamp 171 indicated by the position information of the stamp record in S33 for replacing the QR stamp 171 with the QR stamp 173.

Further, in the MFP 10 and the information processing terminal 50 of the above-described embodiment, an example in which various programs stored in the memories 32 and 62 are executed by the CPUs 31 and 61 to realize respective processes executed by the controller of the present invention Explained. However, the configuration of the controller is not limited to this, and part or all of the controller may be realized by hardware such as an integrated circuit.

Furthermore, the present invention may be realized not only as the MFP 10 and the information processing terminal 50, but also as a program that causes the MFP 10 and the information processing terminal 50 to execute processing. The program may be provided by being recorded in a non-transitory recording medium. The non-transitory recording medium may include a CD-ROM, a DVD-ROM, or the like, as well as a memory mounted in a server connectable to the MFP 10 and the information processing terminal 50 through the communication network 101. Then, the program stored in the memory of the server may be distributed through the communication network 101 such as the Internet as information or a signal indicating the program.

10... MFP
11... Printer 50... Information processing terminal 53... Display 54... Input I/F
55・・・Communication I/F
61... CPU
62... Memory 65... Postcard program 66... URL management program

Claims (8)

A program executable by an information processing terminal including a display and an input interface,
The program is
A first accepting process for accepting a user operation for designating an additional image to be combined with the template image through the input interface;
The information processing terminal is caused to repeatedly execute the display processing of displaying the template image obtained by combining the additional image designated in the first reception processing on the display, and the template image is printed on the communication surface of the postcard. Image, the additional image is a pattern image showing a visually recognizable pattern, or an information holding image that holds information that can be extracted by image processing after being optically read,
The program is
In the display process when the symbol image is specified in the first and second times of the first reception process, the first reception of the symbol image specified in the second time of the first reception process is performed. Display on the near side in the depth direction from the design image specified in the process,
In the display processing when the information holding image is designated in the first reception processing of the first time and the symbol image is designated in the first reception processing of the second time, the information holding image is deeper than the symbol image in the display processing. A program to be displayed on the near side of the direction. The program is
A second accepting process for accepting a designating operation for designating one of the plurality of additional images combined with the template image as a designated image or a canceling operation for canceling designation of the designated image through the input interface;
A first switching process of displaying the specified image on the front side in the depth direction of the additional image different from the specified image in response to the reception of the specified operation in the second reception process;
2. The information processing terminal is caused to execute a second switching process for displaying the information holding image on the front side in the depth direction with respect to the symbol image in response to receiving the release operation in the second receiving process. The program described in. The program is
In the first switching process when the symbol image is designated in the second reception process, the first edit object and the second edit object are displayed on the display,
In the first switching process when the information holding image is designated in the second reception process, only the first edit object of the first edit object and the second edit object is displayed on the display. ,
A third accepting process for accepting a user operation for designating the first edit object or the second edit object through the input interface;
Editing the designated image by a method in which the relative positions of a plurality of pixels forming the designated image do not change on the template image in response to the first editing object being designated in the third reception processing; 1 edit process,
In response to the second editing object being designated in the third reception process, the designated image is changed by a method in which the relative positions of a plurality of pixels forming the designated image may change on the template image. The program according to claim 2, which causes the information processing terminal to execute a second editing process for editing. Wherein the first editing process, the process of deleting the specified image, or a program according to claim 3, wherein the processing for translating the specified image. The program is
In the first switching process when the symbol image is designated in the second reception process, the first edit object and the second edit object are displayed on the display,
In the first switching process when the information holding image is designated in the second reception process, only the first edit object of the first edit object and the second edit object is displayed on the display. ,
A third accepting process for accepting a user operation for designating the first edit object or the second edit object through the input interface;
A first editing process for editing the designated image by a method in which the designated image before and after the editing has a similar shape on the template image in response to the designation of the first editing object in the third reception process. When,
In response to the second editing object being designated in the third reception process, the designated image is changed by a method in which the relative positions of a plurality of pixels forming the designated image may change on the template image. The program according to claim 2, which causes the information processing terminal to execute a second editing process for editing. The first editing process is a process of rotating the designated image at a rotation angle that is an integral multiple of 90 °, a process of enlarging the designated image by N ² (N is a natural number not including 0) times, or the designation. The program according to claim 5 , which is a process of reducing an image by (1/N ² ) times. The information processing terminal includes a communication interface,
The program is
In response to receiving a user operation instructing to print the template image through the input interface, the information processing terminal is caused to execute a print instruction process for transmitting print instruction information to the printer through the communication interface, and the print instruction information is transmitted. The program according to any one of claims 1 to 6 , wherein is the information for printing the template image in which the information holding image is combined on the front side in the depth direction with respect to the pattern image on the communication surface of a postcard. Display,
An input interface,
An information processing terminal including a controller,
The controller is
A first accepting process for accepting a user operation for designating an additional image to be combined with the template image through the input interface;
The template image in which the additional image designated in the first reception process is combined is repeatedly executed with a display process for displaying on the display, and the template image is an image printed on the communication surface of a postcard, The additional image is a pattern image showing a visually recognizable pattern, or an information holding image that holds information that can be extracted by image processing after being optically read,
The controller is
In the display process when the symbol image is specified in the first and second times of the first reception process, the first reception of the symbol image specified in the second time of the first reception process is performed. Display on the near side in the depth direction from the design image specified in the process,
In the display processing when the information holding image is designated in the first reception processing of the first time and the symbol image is designated in the first reception processing of the second time, the information holding image is deeper than the symbol image in the display processing. Information processing terminal to be displayed on the near side of the direction.