JP7626653B2 - Program and recording medium on which said program is recorded - Google Patents

Description

This disclosure relates to a program and a recording medium on which the program is recorded, and in particular to a program and recording medium suitable for assisting in the creation of messages that include pictorial displays.

The following Patent Document 1 discloses an input support device that supports message creation. This input support device accepts input of characters and emojis by a user. When a specific emoji is input, the device searches for other emojis that can be linked with that emoji, and if a linkable emoji is found, suggests that emoji to the user as an input candidate. As a result, when the user performs an input operation on the presented emoji, that emoji is added to the existing emojis and becomes part of the message. With this type of input support device, the user can easily create messages using emojis.

JP 2013-88925 A

A possible method of supporting the inclusion of emoticons or stamps (hereinafter, when there is no need to distinguish between the two, they will be referred to as "emoticons") in messages is to suggest emoticons that match the contents of the input text to the user as input candidates. More specifically, it is possible to compare unconfirmed characters or character strings in the input text with a list of available emoticons, and if there are emoticons that correspond to the former, to display them as input candidates.

In general, when creating a message including pictorial displays in text, a user performs input operations with various intentions in mind. For example, the user may want to convert all or part of an input string of characters into a pictorial display. In addition, the user may want to use a pictorial display by replacing it with a character or character string, or may want to add a pictorial display to existing text. However, until now, including the support method described in Patent Document 1 mentioned above, no support method has been proposed for correctly reflecting such diverse user intentions in a message with simple operations.

This disclosure has been made to solve the problems described above, and its primary objective is to provide a program that allows a user to accurately reflect their intentions in a message that includes pictorial displays with simple operations.

A second object of this disclosure is to provide a computer-readable recording medium that stores a program for allowing a user to correctly reflect their intentions in a message that includes a pictorial display with simple operations.

To achieve the above object, a first aspect of the present disclosure includes a program that causes a computer to execute the following processes: accepting text input; displaying the input text on a display; determining a suggested target within the display; if there are one or more pictorial displays corresponding to the suggested target, displaying a list of the pictorial displays on the display; accepting a designation operation to designate one of the pictorial displays included in the suggestion list; display confirmation processing to confirm the use of the pictorial display that has received the designation operation; and accepting an operation to change the suggested target. It is preferable that the suggested target determination processing is a program including a target change processing to change the suggested target within the display to one corresponding to the change operation, or a recording medium having the program recorded thereon.

In addition, a second aspect of the present disclosure includes a program that causes a computer to execute a process of accepting text input, a process of displaying the entered text on a display, a process of determining a suggested target within the display on the display, a list display process of displaying a suggestion list of pictorial symbols on the display when there is one or more pictorial symbols corresponding to the suggested target, a process of accepting a designation operation to designate one pictorial symbol included in the suggestion list, and a display confirmation process to confirm the use of the pictorial symbol that has received the designation operation, the designation operation including a first designation operation to designate the one pictorial symbol by a first method and a second designation operation to designate the one pictorial symbol by a second method different from the first method, and the display confirmation process including a first confirmation process to replace the pictorial symbol that has received the first designation operation with the suggested target and confirm its use, and a second confirmation process to add the pictorial symbol that has received the second designation operation to the suggested target and confirm its use, or a recording medium having the program recorded thereon.

According to the first and second aspects of the present disclosure, when creating a message including a pictorial display, the user's intention can be correctly reflected in the message with simple operations.

FIG. 2 is a diagram for explaining the configuration of a user terminal used in the first embodiment of the present disclosure. FIG. 2 is a diagram for explaining an input support technique in the first embodiment of the present disclosure. 1 is a flowchart for explaining a flow of processing executed inside a user terminal in the first embodiment of the present disclosure. FIG. 13 is a diagram for explaining an input support technique in the second embodiment of the present disclosure. 13 is a flowchart for explaining the flow of processing executed inside a user terminal in the second embodiment of the present disclosure.

Embodiment 1.
[Configuration of First Embodiment]
1 is a diagram for explaining the configuration of a user terminal 10 used in the first embodiment of the present disclosure. In this embodiment, a case will be explained in which the user terminal 10 is a smartphone. However, the user terminal 10 is not limited to a smartphone, and may be a tablet terminal or a general-purpose computer system.

The user terminal 10 is equipped with a CPU (Central Processing Unit) 18. The CPU 18 is connected to various hardware elements equipped in the user terminal 10 via a bus wiring 20. Various memory devices such as a ROM (Read Only Memory) 22, a RAM (Random Access Memory) 24, and a storage 26 are connected to the bus wiring 20.

The storage 26 includes a non-volatile memory such as a flash ROM. Programs and data required to execute various applications are stored in the storage 26. The CPU 18 performs processing in accordance with the programs stored in the storage 26, thereby realizing the input support function of this embodiment.

The user terminal 10 also includes a communication interface 28. The user terminal 10 can establish wireless communication with external devices via the communication interface 28.

The user terminal 10 further comprises an operation unit 30 and a display unit 32. The operation unit 30 includes a touch panel integrated with the display unit 32, in addition to various mechanical switch mechanisms and electronic sensor mechanisms. In the following, the touch panel will be described as being part of the "display unit 32."

[Operation of the First Embodiment]
2 is a diagram for explaining an input support technique provided by the user terminal 10. A messaging service application is installed in the user terminal 10. Hereinafter, this application is referred to as a "message app." The message app program is stored in a recording medium provided in an external server. The program downloaded from the server is installed in the user terminal 10.

The upper part of FIG. 2 shows a first example screen 32-1 displayed on the display unit 32 of the user terminal 10 after the above-mentioned message app is launched. The first example screen 32-1 includes a message creation area 40. The message creation area 40 is located approximately in the center of the display unit 32. A message that is in the process of being created is displayed in the message creation area 40. The individual characters that make up the message can be input by tapping the desired characters in the keyboard area displayed below the first example screen 32-1. Specifically, the character string "hello" has been input into the message creation area 40 here.

Below the message creation area 40 is a conversion candidate area 42. The conversion candidate area 42 displays a list of conversion candidates that can be predicted from the undetermined parts of the text entered in the message creation area 40. In the first screen example 32-1, for the input of "hello", "hello", "Hello", "HELLO", etc. are listed as conversion candidates in the conversion candidate area 42. A database related to conversion candidates has been created in the storage 26. Conversion candidates are predicted by comparing the undetermined characters or character string with the database.

In the first screen example 32-1, a suggestion area 44 is displayed above the message creation area 40. In the message app of this embodiment, in addition to characters, emoticons and stamps can be used as elements that make up a message. Here, a picture to which a character code is assigned is called an "emoticon," and a picture made up of an image is called a "stamp." In addition, when there is no need to distinguish between emoticons and stamps, they are called "pictorial displays."

The storage 26 stores a database that defines the correspondence between characters or character strings and pictorial displays. When an undetermined portion exists in the text displayed in the message creation area 40, the user terminal 10 searches the database for a pictorial display corresponding to that portion. As a result, if a corresponding pictorial display is not found, the suggestion area 44 is not displayed. On the other hand, if a corresponding pictorial display is found, the suggestion area 44 is displayed as a pop-up, and the pictorial display is shown therein.

The display on the lower left side of FIG. 2 shows a second screen example 32-2 of the display unit 32. The second screen example 32-2 is displayed when a first designation operation 46 is performed on one of the picture display candidates shown in the suggestion area 44 of the first screen example 32-1.

The first designation operation 46 is an operation for replacing a designated pictorial representation with a character or character string corresponding to the pictorial representation and making it part of the message. For example, the first designation operation 46 is realized by the following operation.

1. Among the pictorial displays displayed in the suggestion area 44, tap the pictorial display you want to use (e.g., a rabbit emoji). In response to this tap, the tapped pictorial display may be temporarily enlarged and displayed as a preview display.

2. Tap again on the emoticon tapped in the above process. If the target of the tap is an emoticon, this tap will replace the display in the message creation area 40 from "hello" to "rabbit emoticon", as shown in the second screen example 32-2. If the target of the tap is a stamp, "hello" will disappear from the message creation area 40, and the tapped stamp will be sent as a message to the communication partner instead.

The display on the lower right side of FIG. 2 shows a third example screen 32-3 of the display unit 32. The third example screen 32-3 is displayed when a second designation operation 48 is performed on one of the picture display candidates shown in the suggestion area 44 of the first example screen 32-1.

The second specification operation 48 is an operation for adding the specified pictorial representation to the existing text to make it part of the message. For example, the second specification operation 48 is realized by the following operation.

1. As in the case of the first designation operation, first, one of the pictorial displays displayed in the suggestion area 44 is tapped. As a result, the tapped pictorial display may be temporarily enlarged as a preview display.
2. Swipe the pictorial display tapped in the above process to the right or left. Alternatively, double-tap the pictorial display. If the tapped target is a pictorial symbol, this operation adds a "rabbit pictorial symbol" after "hello" in the message creation area 40, as shown in the third screen example 32-3. If the tapped target is a stamp, the tapped stamp is sent as a message to the communication partner while "hello" remains in the message creation area 40.

After that, when text input is resumed, the newly entered characters are displayed as unconfirmed parts following the existing message in the message creation area 40. Then, when the default send operation is executed, the message displayed in the message creation area 40 at that time is sent to the recipient.

[Processing flow in the first embodiment]
Fig. 3 is a diagram for explaining the flow of processing executed in the user terminal 10 of the present embodiment to realize the input assistance described with reference to Fig. 2. The routine shown in Fig. 3 is repeatedly executed after a message application is launched in the user terminal 10.

In the routine shown in FIG. 3, it is first determined whether new text input has been performed (step 100). If new text input is not recognized, the process skips steps 102 to 106 and immediately proceeds to step 108, which will be described later.

On the other hand, if new text input is recognized, the input characters are added and displayed in the message creation area 40. In addition, conversion candidates are predicted from the undetermined characters or character string, and a list of predicted conversion candidates is displayed in the conversion candidate area 42 (step 102).

Next, it is determined whether there is a suggested candidate pictorial representation corresponding to the undetermined character or character string displayed in the message creation area 40 (step 104). If there is no suggested candidate, the process of step 106 is skipped and the process of step 108 is immediately executed.

On the other hand, if the existence of a suggestion candidate is confirmed, a suggestion area 44 is popped up and a list of suggested pictorial representations is displayed therein (step 106).

Next, it is determined whether or not a confirmation operation has been performed on the unconfirmed characters or character strings displayed in the message creation area 40 (step 108). For example, it is determined whether or not the "return key" included in the keyboard area of the display unit 32 has been tapped. If the result indicates that a confirmation operation has not been performed, the process skips to step 110, and the process proceeds to step 112.

On the other hand, if the execution of the confirmation operation is permitted, the characters or character strings that had been left in an unconfirmed state until then are confirmed as part of the message. In addition, the list of conversion candidates that was displayed corresponding to the unconfirmed characters or character strings is reset (step 110). In the above reset process, for example, the display in the conversion candidate area 42 can be erased. Alternatively, the display in the conversion candidate area 42 can be replaced with a list of conversion candidates that are generally used frequently. Furthermore, the display in the conversion candidate area 42 can be replaced with a list of conversion candidates predicted from the user's conversion history.

Next, it is determined whether or not a first designation operation has been performed on one of the pictorial representations included in the suggestion list (step 112). Specifically, it is determined whether or not the first designation operation described with reference to FIG. 2 has been performed on one of the pictorial representation candidates displayed in the suggestion area 44.

As a result, if the execution of the first designation operation is confirmed, the designated pictorial candidate is confirmed as part of the message, replacing the unconfirmed character or character string displayed in the message creation area 40 (step 114). Specifically, if the pictorial display is an emoticon, the emoticon replaces the unconfirmed character or character string in the message creation area 40. Also, if the above-mentioned pictorial display is a stamp, the unconfirmed character or character string is erased, and the stamp is sent to the communication partner instead. Simultaneously with the above process, the pictorial display suggestion area 44 disappears from the display unit 32.

When the processing of step 114 above is executed, there are no undetermined characters or character strings in the message creation area 40. Therefore, when the processing is completed, the display of the conversion candidate area 42 is reset (step 116), as in the case of step 110 above.

If the suggested list of pictorial displays is not displayed at the time step 112 is executed, there is no possibility that the first specified operation will be executed. In this case, the determination in step 112 is negative. Also, even if the suggested list is displayed at the time step 112 is executed, the determination in step 112 is negative if a certain amount of time has passed or if the execution of another process is recognized. In these cases, it is then determined whether or not the second specified operation has been executed (step 118).

Specifically, in this step 118, it is determined whether or not the second designation operation described with reference to FIG. 2 has been performed for one of the picture display candidates displayed in the suggestion area 44. Here, as in the case of step 112 above, if the suggestion list is not displayed, if a certain amount of time has passed, or if other processing has been performed, it is determined that the second designation operation is not permitted to be performed. In this case, the current routine is promptly terminated. Thereafter, the processing from step 100 onwards is executed again with the displays in each location maintained.

If execution of the second designation operation is confirmed in step 118 above, the designated pictorial representation candidate is added to the unconfirmed characters or character string displayed in the message creation area 40 and confirmed as part of the message (step 120).

Specifically, if the specified pictorial display is an emoji, the emoji is added to the message creation area 40 following the existing text. If the above-mentioned pictorial display is a stamp, the existing text is confirmed as the message, and the specified stamp is sent to the communication partner. Thereafter, the display in the suggestion area 44 disappears, as in step 114.

In addition, when the above process is completed, the undetermined characters or character strings disappear, as in the case where step 116 is executed, and the display of the predicted conversion candidate area 42 is reset.

As described above, according to this embodiment, after inputting characters, the user can selectively perform an operation to replace an unconfirmed part of the text with a pictorial display, or an operation to add a pictorial display to the text. Therefore, according to this embodiment, it is possible to provide input assistance that allows the user's intention to be correctly reflected in the message with a simple operation.

[Modification of the first embodiment]
Incidentally, in the above-described first embodiment, the first designation operation is “tap” + “tap”, and the second designation operation is “tap” + “swipe” or “tap” + “double tap”. However, these operations are not limited to the above operations as long as they are different from each other.

In addition, in the first embodiment, the first and second designation operations are each two-step operations on the premise that a preview display is performed before confirming the use of the pictorial display, but the present disclosure is not limited to this. For example, the preview display before confirmation may be omitted, and these operations may be completed in a single step.

In addition, in the above-described first embodiment, the database related to the pictorial suggestion list and the database for predicting conversion candidates are both stored in the storage 26 of the user terminal 10. However, the present disclosure is not limited to such a configuration. For example, one or both of these databases may be placed on the cloud, and the suggestion list and conversion candidate list may be created via communication.

Embodiment 2.
Next, a second embodiment of the present disclosure will be described with reference to Fig. 1, Fig. 4, and Fig. 5. The input support function in this embodiment can be realized in a user terminal 10 having the hardware configuration shown in Fig. 1, as in the first embodiment. Also, the input support in this embodiment is realized in the user terminal 10 shown in Fig. 1 by the CPU 18 proceeding with processing according to a message application program stored in the storage 26, as in the first embodiment.

[Features of the second embodiment]
In the input assistance of the first embodiment, a pictorial suggestion list is provided for undetermined characters or character strings in the text entered in the message creation area 40. In this assistance method, the characters or character strings that are compared with the pictorial database change every time new characters are entered in the message creation area 40. Hereinafter, such characters or character strings, that is, the object that shows the pictorial suggestion list, will be referred to as a "suggestion object."

With this input assistance method, when the emoticon the user wants to use is displayed, the user must stop inputting text and confirm the use of the emoticon. Then, after confirming the use of the emoticon, the user can start inputting text again. If further character input is performed while the emoticon the user wants to use is displayed as part of the suggestion list, the "intended suggestion target" + "new input characters" become the new suggested target, and the emoticon the user wants to use disappears from the suggestion list. In this case, in order to use the emoticon the user wants to use, the unconfirmed character string must be erased and the "intended suggestion target" must be input again.

The input assistance of this embodiment is characterized in that it overcomes the above-mentioned inconveniences of the first embodiment. Specifically, when a series of character inputs results in text including unconfirmed characters or character strings being displayed in the message creation area 40, the "suggested target" can be changed at the user's request, making it possible to subsequently display a suggestion list that matches the user's intention.

[Operation of the second embodiment]
FIG. 4 is a diagram for explaining the input assistance method in this embodiment. The top part of FIG. 4 shows an example of a screen displayed on the display unit 32 after launching a message application on the user terminal 10. Here, this screen is referred to as a "fourth screen example 32-4". In the fourth screen example 32-4, the characters "Hello!" are displayed in the message creation area 40. Here, the entire character string of "Hello!" is undetermined, and the entire string is considered to be a "suggested target". In the message creation area 40, a suggested target mark 50-1 is displayed so as to overlap the entire "Hello!" in order to clearly indicate that the entire "Hello!" is a suggested target.

In the message app of this embodiment, a pictorial display corresponding to "Hello" and a pictorial display corresponding to "!" are prepared, but a pictorial display corresponding to "Hello!" is not prepared. For this reason, the suggested list of pictorial displays is not displayed in the fourth example screen 32-4.

In this embodiment, a user's operation to change the suggested target is accepted during the message creation process. For example, a right or left swipe operation performed in the message creation area 40 is accepted as a change operation.

The middle part of FIG. 4 shows a fifth example screen 32-5 that is displayed when a change operation 52-1 is performed on the fourth example screen 32-4. In a situation where the suggestion list is not displayed, whether a right swipe or a left swipe is performed, the operation is accepted as a change operation 52-1. When this operation is accepted, a new "suggested target" is determined according to a predefined rule. In this embodiment, specifically, the "suggested target" is determined according to the following rules.

1. It is a part or the whole of an undetermined character or character string displayed in the message creation area 40.
2. It must be a block of characters or letters that has a corresponding pictogram.
3. It must be the rightmost block of characters or letters.
4. It is the smallest block that satisfies conditions 1 to 3.

In the fifth example screen 32-5, following this rule, "!" is the suggested object. Also, to clearly indicate this state, a suggested object mark 50-2 is displayed overlapping the "!".

The fifth screen example 32-5 displays a suggestion area 44, which shows a suggestion list corresponding to the suggestion target "!". If the user finds the pictorial display they want to use in the suggestion area 44, they can confirm that pictorial display as part of the message. On the other hand, if the user finds that the suggestion target is not "!" and the pictorial display they want to use is not present in the suggestion area 44 of the fifth screen example 32-5, they can further change the suggestion target.

The lower left side of FIG. 4 shows a sixth example screen 32-6 that is displayed when a left swipe change operation 52-2 is performed on the suggestion area 44 of the fifth example screen 32-5. A new suggestion list is displayed in the suggestion area 44 of the sixth example screen 32-6, as if the suggestion list that was hidden on the right side of the suggestion area 44 in the fifth example screen 32-5 had been dragged to the left by the swipe. In sync with this action, the suggestion target mark moves to the right in the message creation area 40. Specifically, a cursor-shaped suggestion target mark 50-3 is displayed in the input waiting area located to the right of Hello! In this way, according to the change operation 52-2, the suggestion target can be changed from the state of the fifth example screen 32-5 in a direction according to the type of change operation, and as a result, a new suggestion list can be made to appear.

The lower right side of FIG. 4 shows a seventh example screen 32-7 that is displayed when a right swipe change operation 52-3 is performed on the suggestion area 44 of the fifth example screen 32-5. A new suggestion list is displayed in the suggestion area 44 of the seventh example screen 32-7, as if the suggestion list that was hidden on the left side of the suggestion area 44 in the fifth example screen 32-5 had been dragged into view by the right swipe. In sync with this action, a suggestion target mark 50-4 is displayed in the message creation area 40 so as to overlap with "Hello", the character string block located to the left of the "!". In this way, the right swipe change operation 52-3 can also change the suggestion target from the state of the fifth example screen 32-5 in a direction according to the type of change operation, and a new suggestion list can be made to appear.

According to the above operation, by changing the "suggested target", it is possible to later display a suggestion list that matches the user's intention, and also to provide the following user experience.
1. The swipe direction of the change operation (for example, 52-2, 52-3) matches the direction in which the suggestion list newly appears.
2. The direction in which the suggestion list appears matches the direction in which the suggestion target marks (e.g., 50-2, 50-3, 50-4) move.
This allows the user to accept the movement direction of the suggested object without feeling uncomfortable in relation to the direction of the change operation.

In addition, in this embodiment, as shown in the sixth screen example 32-6, areas waiting for character input (areas where no characters are input) are assumed to be suggested targets. Furthermore, in this embodiment, areas where no characters are input and located to the left of an undetermined character or character string are also assumed to be suggested targets. When these areas are set as suggested targets, pictorial displays that are generally used frequently, or pictorial displays that are used frequently in the user's conversion history, etc. are displayed as a suggestion list. In this way, the input assistance of this embodiment makes it even easier for users to use pictorial displays.

[Processing flow in the second embodiment]
Fig. 5 is a diagram for explaining the flow of processing executed in the user terminal 10 of the present embodiment to realize the input support described with reference to Fig. 4. The routine shown in Fig. 5 is repeatedly executed after a message application is launched in the user terminal 10. In Fig. 5, elements that are the same as those shown in Fig. 3 above are given the same reference numerals, and their explanations are omitted or simplified.

In the routine shown in FIG. 5, similarly to the routine shown in FIG. 3, steps 100 to 110 are first executed. As a result, if there are suggestion candidates for pictorial representations for the undetermined portion of the input text, a suggestion list is displayed in the suggestion area 44. Also, if there are no suggestion candidates for pictorial representations for the undetermined portion, the suggestion list is not displayed.

In either situation, following the processing of steps 100 to 110, it is determined whether a change operation that requests a change to the suggested target has been performed (step 130). If a certain amount of time has passed, or if another operation has been performed, it is determined that the execution of the change operation is not permitted. In this case, the processing of steps 132 to 136 is skipped, and the processing from step 112 onwards is promptly executed.

On the other hand, if the execution of the change operation is confirmed in step 130, a search is first performed to extract suggested targets from within the message creation area 40 (step 132). More specifically, the message creation area 40 is searched for character blocks having corresponding pictorial candidates, as well as non-input character locations. For example, if "Hello!" is input into the message creation area 40, "!", "Hello", "Hell", "H", and the non-input locations to the right and left of Hello! are extracted as suggested target candidates. An identifier is assigned to each of the suggested target candidates extracted in this manner.

Next, it is determined which of the candidates obtained as a result of the search will be the target of suggestion. Specifically, the identifier i of the candidate to be the target of suggestion is determined based on the current display state of the suggestion list and the accepted change operation (step 134). For example, when a change operation 52-1 is performed in the state of the fourth screen example 32-4, the identifier attached to the "!" that satisfies the above-mentioned conditions 1 to 4 becomes i. Also, when a change operation 52-2 of a left swipe is performed in the state of the fifth screen example 32-5, the identifier attached to the non-input part located to the right of the "!" becomes i. Also, for example, when the suggested target is "H" located at the left end of the text and a change operation 52-3 of a right swipe is performed to move the suggested target further to the left, the identifier of the non-input part to the left of the text becomes i.

When the above process is completed, a suggestion list corresponding to the suggested object having the determined i as its identifier, i.e., the i-th suggestion list, is displayed in the suggestion area 44 (step 136). This allows the user to change the suggested object as intended, and the suggestion list corresponding to the suggested object can be made to appear on the display unit 32 of the user terminal 10.

Then, the processing of steps 112 to 120 is executed in the same manner as in the first embodiment. This makes it possible to replace a pictorial display by a first designation operation and add a pictorial display by a second designation operation in the same manner as in the first embodiment.

[Modification of the second embodiment]
Incidentally, in the above-described second embodiment, when the left swipe change operation 52-2 is executed, the suggested target is moved to the right in accordance with the appearance direction (right) of the suggestion list (see the change from 50-2 to 50-3). Similarly, when the right swipe change operation 52-3 is executed, the suggested target is moved to the left in accordance with the appearance direction (left) of the suggestion list (see the change from 50-2 to 50-4). However, the movement direction of the suggested target may be made to match the direction of the swipe, not the appearance direction of the suggestion list. According to such specifications, it is possible to provide an intuitive sense of operation to a user who focuses on the match between the swipe direction and the movement direction of the suggested target, rather than the match between the appearance direction of the suggestion list and the movement direction of the suggested target.

In addition, in the above-mentioned second embodiment, the technology for ex post changing the pictorial suggestion list is combined with the technology described in the first embodiment, that is, the technology that allows the selection of replacing or adding pictorials. However, the present disclosure is not limited to this, and the former technology may be used alone without being combined with the latter technology.

In addition, in the above-mentioned second embodiment, it is permitted to change the suggested target after the fact within the unconfirmed portion of the input text. However, the present disclosure is not limited to this. It is also possible to permit the suggestion target to be changed after the fact to a range that includes confirmed characters in the text.

In the second embodiment described above, a suggestion area 44 containing 12 pictorial displays is popped up in the fifth screen example 32-5, the sixth screen example 32-6, and the seventh screen example 32-7. However, the number of pictorial displays corresponding to each suggested target is not necessarily the same. For this reason, the suggestion area 44 may be enlarged or reduced depending on the number of corresponding pictorial displays. For example, if there are four corresponding pictorial displays, the suggestion area 44 may be reduced in size to a size sufficient to show the four pictorial displays. Also, if there are 16 corresponding pictorial displays, the suggestion area 44 may be enlarged so that they can all be suggested on one screen.

Alternatively, if there are fewer than a predetermined number of pictorial displays corresponding to the suggested target, the suggestion list may include pictorial displays corresponding to the user's usage history and pictorial displays that are generally used frequently, in addition to pictorial displays corresponding to the suggested target. For example, if the standard size of the suggestion area 44 is set to a size that shows 12 pictorial displays, and there are only four pictorial displays corresponding to the suggested target, eight pictorial displays corresponding to the usage history, etc. may be displayed in the suggestion area 44 in addition to the four pictorial displays.

10 User terminal 18 CPU
26 Storage 30 Operation unit 32 Display unit 32-1 First screen example 32-2 Second screen example 32-3 Third screen example 32-4 Fourth screen example 32-5 Fifth screen example 32-6 Sixth screen example 32-7 Seventh screen example 40 Message creation area 42 Conversion candidate area 44 Suggestion area 46 First specified operation 48 Second specified operation 50-1 to 50-4 Suggested target marks 52-1 to 52-3 Change operation

Claims (10)

On the computer,
A process for accepting text input;
Displaying the entered text on a display;
A suggested object determination process for determining a suggested object in the display;
a list display process for displaying a suggestion list of the pictorial representations on the display when one or more pictorial representations corresponding to the suggestion target are present;
A process of receiving a designation operation for designating one pictorial representation included in the suggestion list;
a display confirmation process for confirming the use of the pictorial display for which the designation operation has been performed;
A process of receiving a change operation of the suggested target; and a program for executing the process,
The suggested target determination process includes a target change process for changing the suggested target in the display to one corresponding to the change operation,
The change operation is
An operation for making at least a part of the text displayed on the display the suggested target;
and an operation for making a non-input portion of text on the display the suggested target . The display determination process includes:
a process of replacing the pictorial representation subjected to the designation operation with the text and confirming its use when the suggested target includes the text;
2. The program according to claim 1 , further comprising a process for, when the suggested target is the non-input area, adding the pictorial representation that has been subjected to the designated operation to the text and confirming its use. On the computer,
A process for accepting text input;
Displaying the entered text on a display;
A suggested object determination process for determining a suggested object in the display;
a list display process for displaying a suggestion list of the pictorial representations on the display when one or more pictorial representations corresponding to the suggestion target are present;
A process of receiving a designation operation for designating one pictorial representation included in the suggestion list;
a display confirmation process for confirming the use of the pictorial display for which the designation operation has been performed;
A process of receiving a change operation of the suggested target; and a program for executing the process,
The suggested target determination process includes a target change process for changing the suggested target in the display to one corresponding to the change operation,
The computer further includes a program for causing the computer to execute a process of displaying a mark indicating the suggested object on the display,
the change operation includes an operation of swiping right on the display and an operation of swiping left on the display;
The list display process includes a process of displaying a new suggestion list on the display from the left side of the currently displayed suggestion list in response to the right swipe operation, and a process of displaying a new suggestion list on the display from the right side of the currently displayed suggestion list in response to the left swipe operation,
The object change process is a program including a process of changing the suggested object so that the mark moves to the left in response to the right swipe operation, and a process of changing the suggested object so that the mark moves to the right in response to the left swipe operation. On the computer,
A process for accepting text input;
Displaying the entered text on a display;
A suggested object determination process for determining a suggested object in the display;
a list display process for displaying a suggestion list of the pictorial representations on the display when one or more pictorial representations corresponding to the suggestion target are present;
A process of receiving a designation operation for designating one pictorial representation included in the suggestion list;
a display confirmation process for confirming the use of the pictorial display for which the designation operation has been performed;
A process of receiving a change operation of the suggested target; and a program for executing the process,
The suggested target determination process includes a target change process for changing the suggested target in the display to one corresponding to the change operation,
The computer further includes a program for causing the computer to execute a process of displaying a mark indicating the suggested object on the display,
the change operation includes an operation of swiping right on the display and an operation of swiping left on the display;
The list display process includes a process of displaying a new suggestion list on the display from the left side of the currently displayed suggestion list in response to the right swipe operation, and a process of displaying a new suggestion list on the display from the right side of the currently displayed suggestion list in response to the left swipe operation,
The object change process is a program including a process of changing the suggested object so that the mark moves to the right in response to the right swipe operation, and a process of changing the suggested object so that the mark moves to the left in response to the left swipe operation. On the computer,
Further performing a process to determine the use of the input text;
5. The program according to claim 1 , wherein the list display process displays the suggested list of pictorial representations at a position different from a list of conversion candidates for unconfirmed text whose use has not been confirmed. The pictorial representation is:
Emojis with assigned character codes,
A stamp comprising an image;
The display determination process includes:
When the pictorial display that has been subjected to the designation operation is a pictorial symbol, a process of immediately confirming the use of the pictorial symbol;
a process of displaying a preview of the stamp on the display when the pictorial representation subjected to the designation operation is a stamp;
A process of accepting an approval operation for the previewed stamp;
6. The program according to claim 1, further comprising a process of confirming the use of the stamp upon receipt of the approval operation. The computer includes:
A process for determining the use of the entered text;
and receiving a confirmed display designation operation for designating a part or all of the confirmed text and the confirmed pictorial display,
The program according to claim 1 , wherein the process of determining the suggested target includes a process of determining a part designated by the confirmed display designation operation as the suggested target. On the computer,
A process for accepting text input;
Displaying the entered text on a display;
A suggested object determination process for determining a suggested object in the display;
a list display process for displaying a suggestion list of the pictorial representations on the display when one or more pictorial representations corresponding to the suggestion target are present;
A process of receiving a designation operation for designating one pictorial representation included in the suggestion list;
a display confirmation process for confirming the use of the pictorial display for which the designation operation has been performed,
The designation operation is
a first designation operation for designating the one pictorial representation in a first manner;
a second designation operation for designating the one pictorial representation by a second method different from the first method,
The display determination process includes:
a first determination process for replacing the pictorial indication subjected to the first designation operation with the suggested target and determining its use;
and a second confirmation process for adding the pictorial display that received the second designation operation to the suggested target and confirming its use. The pictorial representation is:
Emojis with assigned character codes,
A stamp comprising an image;
The first determination process and the second determination process each include
When the pictorial display that has been subjected to the designation operation is a pictorial symbol, a process of immediately confirming the use of the pictorial symbol;
a process of displaying a preview of the stamp on the display when the pictorial representation subjected to the designation operation is a stamp;
A process of accepting an approval operation for the previewed stamp;
9. The program according to claim 8 , further comprising a process of confirming the use of the stamp in response to the approval operation. A computer-readable recording medium having the program according to any one of claims 1 to 9 recorded thereon.

Images